2026-03-27 20:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 20:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 20:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-27 20:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-27 20:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 20:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 20:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 20:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 20:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: 19fa629c4677963e
2026-03-27 20:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 20:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-27T20_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 20:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 20:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 20:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 20:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 20:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 20:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 20:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 20:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 20:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 20:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 20:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 20:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 20:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 20:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 20:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 20:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 20:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 20:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 20:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-27 20:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 20:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 20:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 20:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 20:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 20:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 20:35:17 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1659 | hits on page: 40
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-27 20:35:17 [auto1.be] INFO: Scrape type for PX22691: 0
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-27 20:35:17 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-27 20:35:17 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-27 20:35:17 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-27 20:35:17 [auto1.be] INFO: Scrape type for ZP62550: 2
2026-03-27 20:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550
2026-03-27 20:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162ffae6-e742-5a79-87e3-449d0db578ef with scrape type 2
2026-03-27 20:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162ffae6-e742-5a79-87e3-449d0db578ef with scrape type 2
2026-03-27 20:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 162ffae6-e742-5a79-87e3-449d0db578ef, identifier: ZP62550
2026-03-27 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550
2026-03-27 20:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 162ffae6-e742-5a79-87e3-449d0db578ef with identifier: ZP62550 to the API
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:49Z',
 'fuel_type': 'petrol',
 'id': '162ffae6-e742-5a79-87e3-449d0db578ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP62550',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 198659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-22',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-27 20:35:18 [auto1.be] INFO: Saving data for ZP62550: {'auction_closing_time': 1774715809.0, 'created_time': 1774384723.78201, 'last_price_update_time': 1774643718.689757}
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP62550') HTTP/1.1" 204 0
2026-03-27 20:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-27 20:35:18 [auto1.be] INFO: Scrape type for WA82695: 1
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-27 20:35:18 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-27 20:35:18 [auto1.be] INFO: Scrape type for RE30310: 2
2026-03-27 20:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-27 20:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfe35ad-0f16-5719-a748-009caf8a3395 with scrape type 2
2026-03-27 20:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acfe35ad-0f16-5719-a748-009caf8a3395 with scrape type 2
2026-03-27 20:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acfe35ad-0f16-5719-a748-009caf8a3395, identifier: RE30310
2026-03-27 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-27 20:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-27 20:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310 to the API
2026-03-27 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:56:41Z',
 'fuel_type': 'petrol',
 'id': 'acfe35ad-0f16-5719-a748-009caf8a3395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE30310',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 81117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-12',
 'seller_name': None,
 'title': 'BMW 6er 630i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-27 20:35:19 [auto1.be] INFO: Saving data for RE30310: {'auction_closing_time': 1774717001.0, 'created_time': 1773132260.356116, 'last_price_update_time': 1774643719.155769}
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RE30310') HTTP/1.1" 204 0
2026-03-27 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:19 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-27 20:35:19 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA79285%27 HTTP/1.1" 200 None
2026-03-27 20:35:19 [auto1.be] INFO: Scrape type for BA79285: 2
2026-03-27 20:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4adb701d-35f7-5a01-ab1d-eefe5296ca4e with identifier: BA79285
2026-03-27 20:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4adb701d-35f7-5a01-ab1d-eefe5296ca4e with scrape type 2
2026-03-27 20:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4adb701d-35f7-5a01-ab1d-eefe5296ca4e with scrape type 2
2026-03-27 20:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4adb701d-35f7-5a01-ab1d-eefe5296ca4e, identifier: BA79285
2026-03-27 20:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4adb701d-35f7-5a01-ab1d-eefe5296ca4e with identifier: BA79285
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 20:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4adb701d-35f7-5a01-ab1d-eefe5296ca4e with identifier: BA79285
2026-03-27 20:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4adb701d-35f7-5a01-ab1d-eefe5296ca4e with identifier: BA79285 to the API
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:04:20Z',
 'fuel_type': 'petrol',
 'id': '4adb701d-35f7-5a01-ab1d-eefe5296ca4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA79285',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 130468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'BMW 3er 320i GT xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2018}
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA79285%27 HTTP/1.1" 200 None
2026-03-27 20:35:19 [auto1.be] INFO: Saving data for BA79285: {'auction_closing_time': 1774713860.0, 'created_time': 1773137808.164669, 'last_price_update_time': 1774643719.830883}
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA79285') HTTP/1.1" 204 0
2026-03-27 20:35:19 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH21985%27 HTTP/1.1" 200 None
2026-03-27 20:35:19 [auto1.be] INFO: Scrape type for ZH21985: 2
2026-03-27 20:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa2b272-9afb-5b1c-8b08-05ecb8651463 with identifier: ZH21985
2026-03-27 20:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa2b272-9afb-5b1c-8b08-05ecb8651463 with scrape type 2
2026-03-27 20:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aa2b272-9afb-5b1c-8b08-05ecb8651463 with scrape type 2
2026-03-27 20:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0aa2b272-9afb-5b1c-8b08-05ecb8651463, identifier: ZH21985
2026-03-27 20:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0aa2b272-9afb-5b1c-8b08-05ecb8651463 with identifier: ZH21985
2026-03-27 20:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 20:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0aa2b272-9afb-5b1c-8b08-05ecb8651463 with identifier: ZH21985
2026-03-27 20:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0aa2b272-9afb-5b1c-8b08-05ecb8651463 with identifier: ZH21985 to the API
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:08:13Z',
 'fuel_type': 'diesel',
 'id': '0aa2b272-9afb-5b1c-8b08-05ecb8651463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH21985',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 152470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH21985%27 HTTP/1.1" 200 None
2026-03-27 20:35:20 [auto1.be] INFO: Saving data for ZH21985: {'auction_closing_time': 1774714093.0, 'created_time': 1773131989.157466, 'last_price_update_time': 1774643720.370489}
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH21985') HTTP/1.1" 204 0
2026-03-27 20:35:20 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX93406%27 HTTP/1.1" 200 None
2026-03-27 20:35:20 [auto1.be] INFO: Scrape type for WX93406: 2
2026-03-27 20:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43d0cc7c-06b3-5527-abce-c82819816575 with identifier: WX93406
2026-03-27 20:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43d0cc7c-06b3-5527-abce-c82819816575 with scrape type 2
2026-03-27 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43d0cc7c-06b3-5527-abce-c82819816575 with scrape type 2
2026-03-27 20:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43d0cc7c-06b3-5527-abce-c82819816575, identifier: WX93406
2026-03-27 20:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43d0cc7c-06b3-5527-abce-c82819816575 with identifier: WX93406
2026-03-27 20:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43d0cc7c-06b3-5527-abce-c82819816575 with identifier: WX93406
2026-03-27 20:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43d0cc7c-06b3-5527-abce-c82819816575 with identifier: WX93406 to the API
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:54:59Z',
 'fuel_type': 'diesel',
 'id': '43d0cc7c-06b3-5527-abce-c82819816575',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX93406',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 243928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-03',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX93406%27 HTTP/1.1" 200 None
2026-03-27 20:35:20 [auto1.be] INFO: Saving data for WX93406: {'auction_closing_time': 1774716899.0, 'created_time': 1773134445.749375, 'last_price_update_time': 1774643720.771111}
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WX93406') HTTP/1.1" 204 0
2026-03-27 20:35:20 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU23478%27 HTTP/1.1" 200 None
2026-03-27 20:35:20 [auto1.be] INFO: Scrape type for TU23478: 2
2026-03-27 20:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baa738db-9fe1-5f0c-b38c-34a1883bf2c6 with identifier: TU23478
2026-03-27 20:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa738db-9fe1-5f0c-b38c-34a1883bf2c6 with scrape type 2
2026-03-27 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baa738db-9fe1-5f0c-b38c-34a1883bf2c6 with scrape type 2
2026-03-27 20:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: baa738db-9fe1-5f0c-b38c-34a1883bf2c6, identifier: TU23478
2026-03-27 20:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: baa738db-9fe1-5f0c-b38c-34a1883bf2c6 with identifier: TU23478
2026-03-27 20:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: baa738db-9fe1-5f0c-b38c-34a1883bf2c6 with identifier: TU23478
2026-03-27 20:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: baa738db-9fe1-5f0c-b38c-34a1883bf2c6 with identifier: TU23478 to the API
2026-03-27 20:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:21:04Z',
 'fuel_type': 'petrol',
 'id': 'baa738db-9fe1-5f0c-b38c-34a1883bf2c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU23478',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3',
 'odometer': 81532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-07',
 'seller_name': None,
 'title': 'Audi RS 3 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU23478%27 HTTP/1.1" 200 None
2026-03-27 20:35:21 [auto1.be] INFO: Saving data for TU23478: {'auction_closing_time': 1774714864.0, 'created_time': 1773241015.775685, 'last_price_update_time': 1774643721.164875}
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU23478') HTTP/1.1" 204 0
2026-03-27 20:35:21 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-27 20:35:21 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH68811%27 HTTP/1.1" 200 None
2026-03-27 20:35:21 [auto1.be] INFO: Scrape type for NH68811: 2
2026-03-27 20:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74b37d4-a6bd-5163-91d5-f3138b63ca26 with identifier: NH68811
2026-03-27 20:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74b37d4-a6bd-5163-91d5-f3138b63ca26 with scrape type 2
2026-03-27 20:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f74b37d4-a6bd-5163-91d5-f3138b63ca26 with scrape type 2
2026-03-27 20:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f74b37d4-a6bd-5163-91d5-f3138b63ca26, identifier: NH68811
2026-03-27 20:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f74b37d4-a6bd-5163-91d5-f3138b63ca26 with identifier: NH68811
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 20:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f74b37d4-a6bd-5163-91d5-f3138b63ca26 with identifier: NH68811
2026-03-27 20:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f74b37d4-a6bd-5163-91d5-f3138b63ca26 with identifier: NH68811 to the API
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:40:35Z',
 'fuel_type': 'diesel',
 'id': 'f74b37d4-a6bd-5163-91d5-f3138b63ca26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH68811',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 22862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH68811%27 HTTP/1.1" 200 None
2026-03-27 20:35:21 [auto1.be] INFO: Saving data for NH68811: {'auction_closing_time': 1774716035.0, 'created_time': 1773131901.716713, 'last_price_update_time': 1774643721.652117}
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH68811') HTTP/1.1" 204 0
2026-03-27 20:35:21 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-27 20:35:21 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK39898%27 HTTP/1.1" 200 None
2026-03-27 20:35:21 [auto1.be] INFO: Scrape type for SK39898: 2
2026-03-27 20:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b167464-05f4-55f1-9b47-99a73ddec41b with identifier: SK39898
2026-03-27 20:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b167464-05f4-55f1-9b47-99a73ddec41b with scrape type 2
2026-03-27 20:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b167464-05f4-55f1-9b47-99a73ddec41b with scrape type 2
2026-03-27 20:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b167464-05f4-55f1-9b47-99a73ddec41b, identifier: SK39898
2026-03-27 20:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b167464-05f4-55f1-9b47-99a73ddec41b with identifier: SK39898
2026-03-27 20:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b167464-05f4-55f1-9b47-99a73ddec41b with identifier: SK39898
2026-03-27 20:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b167464-05f4-55f1-9b47-99a73ddec41b with identifier: SK39898 to the API
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:57:06Z',
 'fuel_type': 'diesel',
 'id': '3b167464-05f4-55f1-9b47-99a73ddec41b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK39898',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 202309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-31',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2011}
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK39898%27 HTTP/1.1" 200 None
2026-03-27 20:35:22 [auto1.be] INFO: Saving data for SK39898: {'auction_closing_time': 1774717026.0, 'created_time': 1773240652.693451, 'last_price_update_time': 1774643722.023496}
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK39898') HTTP/1.1" 204 0
2026-03-27 20:35:22 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-27 20:35:22 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-27 20:35:22 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY11434%27 HTTP/1.1" 200 None
2026-03-27 20:35:22 [auto1.be] INFO: Scrape type for NY11434: 2
2026-03-27 20:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8437f95-bed9-5e9c-bd1c-7af99162b13c with identifier: NY11434
2026-03-27 20:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8437f95-bed9-5e9c-bd1c-7af99162b13c with scrape type 2
2026-03-27 20:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8437f95-bed9-5e9c-bd1c-7af99162b13c with scrape type 2
2026-03-27 20:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8437f95-bed9-5e9c-bd1c-7af99162b13c, identifier: NY11434
2026-03-27 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8437f95-bed9-5e9c-bd1c-7af99162b13c with identifier: NY11434
2026-03-27 20:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8437f95-bed9-5e9c-bd1c-7af99162b13c with identifier: NY11434
2026-03-27 20:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8437f95-bed9-5e9c-bd1c-7af99162b13c with identifier: NY11434 to the API
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:34:59Z',
 'fuel_type': 'diesel',
 'id': 'e8437f95-bed9-5e9c-bd1c-7af99162b13c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY11434',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 150628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2013}
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY11434%27 HTTP/1.1" 200 None
2026-03-27 20:35:22 [auto1.be] INFO: Saving data for NY11434: {'auction_closing_time': 1774715699.0, 'created_time': 1773136723.735701, 'last_price_update_time': 1774643722.427554}
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY11434') HTTP/1.1" 204 0
2026-03-27 20:35:22 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE88192%27 HTTP/1.1" 200 None
2026-03-27 20:35:22 [auto1.be] INFO: Scrape type for XE88192: 2
2026-03-27 20:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dff758a-cded-5b7a-bd7a-735c10ef0630 with identifier: XE88192
2026-03-27 20:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dff758a-cded-5b7a-bd7a-735c10ef0630 with scrape type 2
2026-03-27 20:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dff758a-cded-5b7a-bd7a-735c10ef0630 with scrape type 2
2026-03-27 20:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4dff758a-cded-5b7a-bd7a-735c10ef0630, identifier: XE88192
2026-03-27 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA82695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4dff758a-cded-5b7a-bd7a-735c10ef0630 with identifier: XE88192
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 20:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4dff758a-cded-5b7a-bd7a-735c10ef0630 with identifier: XE88192
2026-03-27 20:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4dff758a-cded-5b7a-bd7a-735c10ef0630 with identifier: XE88192 to the API
2026-03-27 20:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:38Z',
 'fuel_type': 'diesel',
 'id': '4dff758a-cded-5b7a-bd7a-735c10ef0630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE88192',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 148058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-25',
 'seller_name': None,
 'title': 'Audi Q2 35 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE88192%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Saving data for XE88192: {'auction_closing_time': 1774716398.0, 'created_time': 1773224194.01447, 'last_price_update_time': 1774643723.108041}
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE88192') HTTP/1.1" 204 0
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55081%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Scrape type for FU55081: 2
2026-03-27 20:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead0952c-e3be-56c6-8177-34d8907f4220 with identifier: FU55081
2026-03-27 20:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead0952c-e3be-56c6-8177-34d8907f4220 with scrape type 2
2026-03-27 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ead0952c-e3be-56c6-8177-34d8907f4220 with scrape type 2
2026-03-27 20:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ead0952c-e3be-56c6-8177-34d8907f4220, identifier: FU55081
2026-03-27 20:35:23 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1659 | hits on page: 40
2026-03-27 20:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ead0952c-e3be-56c6-8177-34d8907f4220 with identifier: FU55081
2026-03-27 20:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ead0952c-e3be-56c6-8177-34d8907f4220 with identifier: FU55081
2026-03-27 20:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ead0952c-e3be-56c6-8177-34d8907f4220 with identifier: FU55081 to the API
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-28T16:55:33Z',
 'fuel_type': 'diesel',
 'id': 'ead0952c-e3be-56c6-8177-34d8907f4220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU55081',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 199876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-11',
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranSport',
 'transmission': 'automatic',
 'trim': 'GranSport',
 'year': 2019}
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55081%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Saving data for FU55081: {'auction_closing_time': 1774716933.0, 'created_time': 1773136328.557583, 'last_price_update_time': 1774643723.523162}
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FU55081') HTTP/1.1" 204 0
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB14392%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Scrape type for RB14392: 2
2026-03-27 20:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a49d748-d872-5868-8558-fb1a670e5d76 with identifier: RB14392
2026-03-27 20:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a49d748-d872-5868-8558-fb1a670e5d76 with scrape type 2
2026-03-27 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a49d748-d872-5868-8558-fb1a670e5d76 with scrape type 2
2026-03-27 20:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a49d748-d872-5868-8558-fb1a670e5d76, identifier: RB14392
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Scrape type for PX22691: 0
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-27 20:35:23 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-27 20:35:23 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-27 20:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a49d748-d872-5868-8558-fb1a670e5d76 with identifier: RB14392
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-27 20:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a49d748-d872-5868-8558-fb1a670e5d76 with identifier: RB14392
2026-03-27 20:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a49d748-d872-5868-8558-fb1a670e5d76 with identifier: RB14392 to the API
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:02Z',
 'fuel_type': 'diesel',
 'id': '5a49d748-d872-5868-8558-fb1a670e5d76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB14392',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 165459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB14392%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Saving data for RB14392: {'auction_closing_time': 1774713842.0, 'created_time': 1773131947.491605, 'last_price_update_time': 1774643724.218034}
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB14392') HTTP/1.1" 204 0
2026-03-27 20:35:24 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/WA82695/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 20:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY55708%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for MY55708: 2
2026-03-27 20:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18404cd1-6e4c-500b-b671-217c07747b40 with identifier: MY55708
2026-03-27 20:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18404cd1-6e4c-500b-b671-217c07747b40 with scrape type 2
2026-03-27 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18404cd1-6e4c-500b-b671-217c07747b40 with scrape type 2
2026-03-27 20:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18404cd1-6e4c-500b-b671-217c07747b40, identifier: MY55708
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA79285%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for BA79285: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH21985%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for ZH21985: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX93406%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for WX93406: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU23478%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for TU23478: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH68811%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for NH68811: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK39898%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for SK39898: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY11434%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for NY11434: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE88192%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for XE88192: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55081%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for FU55081: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB14392%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for RB14392: 0
2026-03-27 20:35:24 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY55708%27 HTTP/1.1" 200 None
2026-03-27 20:35:24 [auto1.be] INFO: Scrape type for MY55708: 2
2026-03-27 20:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18404cd1-6e4c-500b-b671-217c07747b40 with scrape type 2
2026-03-27 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18404cd1-6e4c-500b-b671-217c07747b40 with scrape type 2
2026-03-27 20:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18404cd1-6e4c-500b-b671-217c07747b40, identifier: MY55708
2026-03-27 20:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18404cd1-6e4c-500b-b671-217c07747b40 with identifier: MY55708
2026-03-27 20:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18404cd1-6e4c-500b-b671-217c07747b40 with identifier: MY55708
2026-03-27 20:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18404cd1-6e4c-500b-b671-217c07747b40 with identifier: MY55708 to the API
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:45Z',
 'fuel_type': 'diesel',
 'id': '18404cd1-6e4c-500b-b671-217c07747b40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY55708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 295309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY55708%27 HTTP/1.1" 200 None
2026-03-27 20:35:25 [auto1.be] INFO: Saving data for MY55708: {'auction_closing_time': 1774714065.0, 'created_time': 1773132034.601488, 'last_price_update_time': 1774643725.037022}
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MY55708') HTTP/1.1" 204 0
2026-03-27 20:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18404cd1-6e4c-500b-b671-217c07747b40 with identifier: MY55708
2026-03-27 20:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18404cd1-6e4c-500b-b671-217c07747b40 with identifier: MY55708
2026-03-27 20:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18404cd1-6e4c-500b-b671-217c07747b40 with identifier: MY55708 to the API
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:45Z',
 'fuel_type': 'diesel',
 'id': '18404cd1-6e4c-500b-b671-217c07747b40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY55708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 295309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY55708%27 HTTP/1.1" 200 None
2026-03-27 20:35:25 [auto1.be] INFO: Saving data for MY55708: {'auction_closing_time': 1774714065.0, 'created_time': 1773132034.601488, 'last_price_update_time': 1774643725.373668}
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MY55708') HTTP/1.1" 204 0
2026-03-27 20:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:25 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK15851%27 HTTP/1.1" 200 None
2026-03-27 20:35:25 [auto1.be] INFO: Scrape type for XK15851: 2
2026-03-27 20:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58f1e437-7591-59e0-8cfd-0018a590bb1a with identifier: XK15851
2026-03-27 20:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f1e437-7591-59e0-8cfd-0018a590bb1a with scrape type 2
2026-03-27 20:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58f1e437-7591-59e0-8cfd-0018a590bb1a with scrape type 2
2026-03-27 20:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58f1e437-7591-59e0-8cfd-0018a590bb1a, identifier: XK15851
2026-03-27 20:35:25 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK15851%27 HTTP/1.1" 200 None
2026-03-27 20:35:25 [auto1.be] INFO: Scrape type for XK15851: 2
2026-03-27 20:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f1e437-7591-59e0-8cfd-0018a590bb1a with scrape type 2
2026-03-27 20:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58f1e437-7591-59e0-8cfd-0018a590bb1a with scrape type 2
2026-03-27 20:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58f1e437-7591-59e0-8cfd-0018a590bb1a, identifier: XK15851
2026-03-27 20:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58f1e437-7591-59e0-8cfd-0018a590bb1a with identifier: XK15851
2026-03-27 20:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58f1e437-7591-59e0-8cfd-0018a590bb1a with identifier: XK15851
2026-03-27 20:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58f1e437-7591-59e0-8cfd-0018a590bb1a with identifier: XK15851 to the API
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:41:15Z',
 'fuel_type': 'diesel',
 'id': '58f1e437-7591-59e0-8cfd-0018a590bb1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK15851',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 92139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 116 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2018}
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK15851%27 HTTP/1.1" 200 None
2026-03-27 20:35:25 [auto1.be] INFO: Saving data for XK15851: {'auction_closing_time': 1774716075.0, 'created_time': 1773133548.993555, 'last_price_update_time': 1774643725.885193}
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK15851') HTTP/1.1" 204 0
2026-03-27 20:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58f1e437-7591-59e0-8cfd-0018a590bb1a with identifier: XK15851
2026-03-27 20:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58f1e437-7591-59e0-8cfd-0018a590bb1a with identifier: XK15851
2026-03-27 20:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58f1e437-7591-59e0-8cfd-0018a590bb1a with identifier: XK15851 to the API
2026-03-27 20:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:41:15Z',
 'fuel_type': 'diesel',
 'id': '58f1e437-7591-59e0-8cfd-0018a590bb1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK15851',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 92139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 116 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2018}
2026-03-27 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK15851%27 HTTP/1.1" 200 None
2026-03-27 20:35:26 [auto1.be] INFO: Saving data for XK15851: {'auction_closing_time': 1774716075.0, 'created_time': 1773133548.993555, 'last_price_update_time': 1774643726.144575}
2026-03-27 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK15851') HTTP/1.1" 204 0
2026-03-27 20:35:26 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-27 20:35:26 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-27 20:35:26 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-27 20:35:26 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-27 20:35:26 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-27 20:35:26 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-27 20:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA82695> (referer: https://www.auto1.com/v1/car-details-view/WA82695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-27 20:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40829756-87ea-549d-9f2d-20fe2305b3cd with scrape type 1
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40829756-87ea-549d-9f2d-20fe2305b3cd
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_57efaba6b94fb1801072eb9fb5d7bd06.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_57efaba6b94fb1801072eb9fb5d7bd06.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_13a28bf07b1aeb484a440b50fbfff260.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_13a28bf07b1aeb484a440b50fbfff260.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_457a2e2cf03e835ada605272e0b9cb2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_457a2e2cf03e835ada605272e0b9cb2b.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_9fff852f2364321913016283ae831d45.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_9fff852f2364321913016283ae831d45.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_95639b9fbada7a8042e89eeeb1d79261.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_95639b9fbada7a8042e89eeeb1d79261.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_ac57b7c6edbf8a25b0bac3c2443fcbe9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_ac57b7c6edbf8a25b0bac3c2443fcbe9.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_9619301cd5d7bc218e409f2d91fb0d00.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_9619301cd5d7bc218e409f2d91fb0d00.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_0b252bcf8e20856c73205b9d03da1576.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_0b252bcf8e20856c73205b9d03da1576.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_0f219698d78433f5473b7b0a93af5707.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_0f219698d78433f5473b7b0a93af5707.jpg already downloaded
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F0b%252Fa60ba0fe4dcf48cfbe634097bb2e1db8%252Fpa%252FWA82695_20305ef856d7662e3d550b9c7ae40ea6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_20305ef856d7662e3d550b9c7ae40ea6.jpg already downloaded
2026-03-27 20:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40829756-87ea-549d-9f2d-20fe2305b3cd, identifier: WA82695
2026-03-27 20:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-27 20:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-27 20:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695 to the API
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA82695>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:45:11Z',
 'fuel_type': 'petrol',
 'id': '40829756-87ea-549d-9f2d-20fe2305b3cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA82695',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 172767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_57efaba6b94fb1801072eb9fb5d7bd06.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_13a28bf07b1aeb484a440b50fbfff260.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_457a2e2cf03e835ada605272e0b9cb2b.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_9fff852f2364321913016283ae831d45.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_95639b9fbada7a8042e89eeeb1d79261.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_ac57b7c6edbf8a25b0bac3c2443fcbe9.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_9619301cd5d7bc218e409f2d91fb0d00.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_0b252bcf8e20856c73205b9d03da1576.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_0f219698d78433f5473b7b0a93af5707.jpg',
                'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_20305ef856d7662e3d550b9c7ae40ea6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_57efaba6b94fb1801072eb9fb5d7bd06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_13a28bf07b1aeb484a440b50fbfff260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606699,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_457a2e2cf03e835ada605272e0b9cb2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_9fff852f2364321913016283ae831d45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_95639b9fbada7a8042e89eeeb1d79261.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_ac57b7c6edbf8a25b0bac3c2443fcbe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_9619301cd5d7bc218e409f2d91fb0d00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_0b252bcf8e20856c73205b9d03da1576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_0f219698d78433f5473b7b0a93af5707.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40829756-87ea-549d-9f2d-20fe2305b3cd/40829756-87ea-549d-9f2d-20fe2305b3cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/0b/a60ba0fe4dcf48cfbe634097bb2e1db8/pa/WA82695_20305ef856d7662e3d550b9c7ae40ea6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 THP Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2016}
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [auto1.be] INFO: Saving data for WA82695: {'created_time': 1774643727.751686, 'last_price_update_time': 1774643727.751698, 'auction_closing_time': 1774716311.0}
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA82695') HTTP/1.1" 204 0
2026-03-27 20:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:27 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1659 | hits on page: 40
2026-03-27 20:35:27 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA93870%27 HTTP/1.1" 200 None
2026-03-27 20:35:27 [auto1.be] INFO: Scrape type for TA93870: 2
2026-03-27 20:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352cce9e-a04b-5530-8605-e818efe8a99d with identifier: TA93870
2026-03-27 20:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352cce9e-a04b-5530-8605-e818efe8a99d with scrape type 2
2026-03-27 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 352cce9e-a04b-5530-8605-e818efe8a99d with scrape type 2
2026-03-27 20:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 352cce9e-a04b-5530-8605-e818efe8a99d, identifier: TA93870
2026-03-27 20:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 352cce9e-a04b-5530-8605-e818efe8a99d with identifier: TA93870
2026-03-27 20:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 352cce9e-a04b-5530-8605-e818efe8a99d with identifier: TA93870
2026-03-27 20:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 352cce9e-a04b-5530-8605-e818efe8a99d with identifier: TA93870 to the API
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:15:45Z',
 'fuel_type': 'petrol',
 'id': '352cce9e-a04b-5530-8605-e818efe8a99d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA93870',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 151032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA93870%27 HTTP/1.1" 200 None
2026-03-27 20:35:28 [auto1.be] INFO: Saving data for TA93870: {'auction_closing_time': 1774714545.0, 'created_time': 1773301718.217417, 'last_price_update_time': 1774643728.263058}
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TA93870') HTTP/1.1" 204 0
2026-03-27 20:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF06459%27 HTTP/1.1" 200 None
2026-03-27 20:35:28 [auto1.be] INFO: Scrape type for JF06459: 2
2026-03-27 20:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 763df034-7547-5a6e-b653-ed439b36c98f with identifier: JF06459
2026-03-27 20:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 763df034-7547-5a6e-b653-ed439b36c98f with scrape type 2
2026-03-27 20:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 763df034-7547-5a6e-b653-ed439b36c98f with scrape type 2
2026-03-27 20:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 763df034-7547-5a6e-b653-ed439b36c98f, identifier: JF06459
2026-03-27 20:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 763df034-7547-5a6e-b653-ed439b36c98f with identifier: JF06459
2026-03-27 20:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 763df034-7547-5a6e-b653-ed439b36c98f with identifier: JF06459
2026-03-27 20:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 763df034-7547-5a6e-b653-ed439b36c98f with identifier: JF06459 to the API
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:38:43Z',
 'fuel_type': 'petrol',
 'id': '763df034-7547-5a6e-b653-ed439b36c98f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF06459',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 92866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF06459%27 HTTP/1.1" 200 None
2026-03-27 20:35:28 [auto1.be] INFO: Saving data for JF06459: {'auction_closing_time': 1774715923.0, 'created_time': 1773136922.066856, 'last_price_update_time': 1774643728.67902}
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JF06459') HTTP/1.1" 204 0
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ99747%27 HTTP/1.1" 200 None
2026-03-27 20:35:28 [auto1.be] INFO: Scrape type for PZ99747: 1
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB53896%27 HTTP/1.1" 200 None
2026-03-27 20:35:28 [auto1.be] INFO: Scrape type for TB53896: 1
2026-03-27 20:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:28 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL30549%27 HTTP/1.1" 200 None
2026-03-27 20:35:28 [auto1.be] INFO: Scrape type for PL30549: 2
2026-03-27 20:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc78e67-7142-582e-80cd-8877f01fec29 with identifier: PL30549
2026-03-27 20:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc78e67-7142-582e-80cd-8877f01fec29 with scrape type 2
2026-03-27 20:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc78e67-7142-582e-80cd-8877f01fec29 with scrape type 2
2026-03-27 20:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ddc78e67-7142-582e-80cd-8877f01fec29, identifier: PL30549
2026-03-27 20:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ddc78e67-7142-582e-80cd-8877f01fec29 with identifier: PL30549
2026-03-27 20:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ddc78e67-7142-582e-80cd-8877f01fec29 with identifier: PL30549
2026-03-27 20:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ddc78e67-7142-582e-80cd-8877f01fec29 with identifier: PL30549 to the API
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'petrol',
 'id': 'ddc78e67-7142-582e-80cd-8877f01fec29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL30549',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 74774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL30549%27 HTTP/1.1" 200 None
2026-03-27 20:35:29 [auto1.be] INFO: Saving data for PL30549: {'auction_closing_time': 1774716351.0, 'created_time': 1773137557.389567, 'last_price_update_time': 1774643729.212729}
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL30549') HTTP/1.1" 204 0
2026-03-27 20:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS47676%27 HTTP/1.1" 200 None
2026-03-27 20:35:29 [auto1.be] INFO: Scrape type for KS47676: 1
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU28222%27 HTTP/1.1" 200 None
2026-03-27 20:35:29 [auto1.be] INFO: Scrape type for KU28222: 2
2026-03-27 20:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa98415-968c-50c6-ae18-c39fc23338bd with identifier: KU28222
2026-03-27 20:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa98415-968c-50c6-ae18-c39fc23338bd with scrape type 2
2026-03-27 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aa98415-968c-50c6-ae18-c39fc23338bd with scrape type 2
2026-03-27 20:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aa98415-968c-50c6-ae18-c39fc23338bd, identifier: KU28222
2026-03-27 20:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aa98415-968c-50c6-ae18-c39fc23338bd with identifier: KU28222
2026-03-27 20:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aa98415-968c-50c6-ae18-c39fc23338bd with identifier: KU28222
2026-03-27 20:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aa98415-968c-50c6-ae18-c39fc23338bd with identifier: KU28222 to the API
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:10:30Z',
 'fuel_type': 'petrol',
 'id': '6aa98415-968c-50c6-ae18-c39fc23338bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU28222',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 164543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-18',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU28222%27 HTTP/1.1" 200 None
2026-03-27 20:35:29 [auto1.be] INFO: Saving data for KU28222: {'auction_closing_time': 1774714230.0, 'created_time': 1773224678.811173, 'last_price_update_time': 1774643729.647785}
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU28222') HTTP/1.1" 204 0
2026-03-27 20:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-27 20:35:29 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN33262%27 HTTP/1.1" 200 None
2026-03-27 20:35:29 [auto1.be] INFO: Scrape type for LN33262: 2
2026-03-27 20:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c996c8f4-5d7e-54bf-b89d-e68a67d79ee6 with identifier: LN33262
2026-03-27 20:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c996c8f4-5d7e-54bf-b89d-e68a67d79ee6 with scrape type 2
2026-03-27 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c996c8f4-5d7e-54bf-b89d-e68a67d79ee6 with scrape type 2
2026-03-27 20:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c996c8f4-5d7e-54bf-b89d-e68a67d79ee6, identifier: LN33262
2026-03-27 20:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c996c8f4-5d7e-54bf-b89d-e68a67d79ee6 with identifier: LN33262
2026-03-27 20:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c996c8f4-5d7e-54bf-b89d-e68a67d79ee6 with identifier: LN33262
2026-03-27 20:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c996c8f4-5d7e-54bf-b89d-e68a67d79ee6 with identifier: LN33262 to the API
2026-03-27 20:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:23Z',
 'fuel_type': 'diesel',
 'id': 'c996c8f4-5d7e-54bf-b89d-e68a67d79ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN33262',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 209079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-03',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Classic blue 2WD',
 'transmission': 'automatic',
 'trim': 'Classic blue 2WD',
 'year': 2017}
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN33262%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Saving data for LN33262: {'auction_closing_time': 1774714763.0, 'created_time': 1773136418.701148, 'last_price_update_time': 1774643730.170656}
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LN33262') HTTP/1.1" 204 0
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC85996%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Scrape type for XC85996: 1
2026-03-27 20:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Scrape type for PY58607: 1
2026-03-27 20:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Scrape type for AU41446: 1
2026-03-27 20:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Scrape type for WS04459: 2
2026-03-27 20:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-27 20:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c4374bf-0d03-5ed8-bb70-d50388a9707d with scrape type 2
2026-03-27 20:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c4374bf-0d03-5ed8-bb70-d50388a9707d with scrape type 2
2026-03-27 20:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c4374bf-0d03-5ed8-bb70-d50388a9707d, identifier: WS04459
2026-03-27 20:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-27 20:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-27 20:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459 to the API
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:07:39Z',
 'fuel_type': 'diesel',
 'id': '1c4374bf-0d03-5ed8-bb70-d50388a9707d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS04459',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 180366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Exceed',
 'transmission': 'automatic',
 'trim': 'Exceed',
 'year': 2017}
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Saving data for WS04459: {'auction_closing_time': 1774714059.0, 'created_time': 1773434395.222802, 'last_price_update_time': 1774643730.636658}
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WS04459') HTTP/1.1" 204 0
2026-03-27 20:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Scrape type for XA29570: 1
2026-03-27 20:35:30 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1659 | hits on page: 40
2026-03-27 20:35:30 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-27 20:35:30 [auto1.be] INFO: Scrape type for PU90284: 2
2026-03-27 20:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-27 20:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with scrape type 2
2026-03-27 20:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with scrape type 2
2026-03-27 20:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8abb6001-164c-5d9d-9ae1-286dc8a366f2, identifier: PU90284
2026-03-27 20:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-27 20:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-27 20:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284 to the API
2026-03-27 20:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:05Z',
 'fuel_type': 'petrol',
 'id': '8abb6001-164c-5d9d-9ae1-286dc8a366f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU90284',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-27 20:35:31 [auto1.be] INFO: Saving data for PU90284: {'auction_closing_time': 1774713725.0, 'created_time': 1773301732.687763, 'last_price_update_time': 1774643731.185394}
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PU90284') HTTP/1.1" 204 0
2026-03-27 20:35:31 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-27 20:35:31 [auto1.be] INFO: Scrape type for SX32022: 2
2026-03-27 20:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-27 20:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e962ff3b-5daf-58c4-878a-679afeaf0974 with scrape type 2
2026-03-27 20:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e962ff3b-5daf-58c4-878a-679afeaf0974 with scrape type 2
2026-03-27 20:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e962ff3b-5daf-58c4-878a-679afeaf0974, identifier: SX32022
2026-03-27 20:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:31 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-27 20:35:31 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-27 20:35:31 [auto1.be] INFO: Scrape type for JZ92177: 2
2026-03-27 20:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-27 20:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with scrape type 2
2026-03-27 20:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with scrape type 2
2026-03-27 20:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 979ebab0-c3db-57cc-9de9-b9e30813e9d1, identifier: JZ92177
2026-03-27 20:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-27 20:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-27 20:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022 to the API
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:40:52Z',
 'fuel_type': 'petrol',
 'id': 'e962ff3b-5daf-58c4-878a-679afeaf0974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX32022',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 97443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-18',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-27 20:35:31 [auto1.be] INFO: Saving data for SX32022: {'auction_closing_time': 1774716052.0, 'created_time': 1773909325.798418, 'last_price_update_time': 1774643731.842246}
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX32022') HTTP/1.1" 204 0
2026-03-27 20:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-27 20:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-27 20:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177 to the API
2026-03-27 20:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:26Z',
 'fuel_type': 'petrol',
 'id': '979ebab0-c3db-57cc-9de9-b9e30813e9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ92177',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 19719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-07',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2024}
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Saving data for JZ92177: {'auction_closing_time': 1774715186.0, 'created_time': 1773238513.89548, 'last_price_update_time': 1774643732.16056}
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ92177') HTTP/1.1" 204 0
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ92638%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for EZ92638: 0
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for NN69701: 1
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-27 20:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ99747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68139%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for GM68139: 0
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for VL69873: 2
2026-03-27 20:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-27 20:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with scrape type 2
2026-03-27 20:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with scrape type 2
2026-03-27 20:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5, identifier: VL69873
2026-03-27 20:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB53896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS47676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-27 20:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-27 20:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873 to the API
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:25:29Z',
 'fuel_type': 'diesel',
 'id': '5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL69873',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 196575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Saving data for VL69873: {'auction_closing_time': 1774715129.0, 'created_time': 1773866411.866313, 'last_price_update_time': 1774643732.613542}
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL69873') HTTP/1.1" 204 0
2026-03-27 20:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for JP67733: 1
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56450%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for CW56450: 0
2026-03-27 20:35:32 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-27 20:35:32 [auto1.be] INFO: Scrape type for YM63500: 2
2026-03-27 20:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-27 20:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with scrape type 2
2026-03-27 20:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with scrape type 2
2026-03-27 20:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea, identifier: YM63500
2026-03-27 20:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-27 20:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-27 20:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500 to the API
2026-03-27 20:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:21Z',
 'fuel_type': 'diesel',
 'id': '29f8fd09-4026-5a84-97ce-6a3bc50c58ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM63500',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 119815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 2WD',
 'transmission': 'manual',
 'trim': '2WD',
 'year': 2019}
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-27 20:35:33 [auto1.be] INFO: Saving data for YM63500: {'auction_closing_time': 1774716381.0, 'created_time': 1773384022.03285, 'last_price_update_time': 1774643733.160498}
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YM63500') HTTP/1.1" 204 0
2026-03-27 20:35:33 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-27 20:35:33 [auto1.be] INFO: Scrape type for AG87445: 1
2026-03-27 20:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU41446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:33 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-27 20:35:33 [auto1.be] INFO: Scrape type for VA33507: 2
2026-03-27 20:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-27 20:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9602a68-0826-50df-9626-ca57389c77f7 with scrape type 2
2026-03-27 20:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9602a68-0826-50df-9626-ca57389c77f7 with scrape type 2
2026-03-27 20:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9602a68-0826-50df-9626-ca57389c77f7, identifier: VA33507
2026-03-27 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC85996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY58607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-27 20:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507 to the API
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:16Z',
 'fuel_type': 'diesel',
 'id': 'e9602a68-0826-50df-9626-ca57389c77f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA33507',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 179135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-27 20:35:33 [auto1.be] INFO: Saving data for VA33507: {'auction_closing_time': 1774713796.0, 'created_time': 1773138050.607634, 'last_price_update_time': 1774643733.735996}
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA33507') HTTP/1.1" 204 0
2026-03-27 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:33 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-27 20:35:33 [auto1.be] INFO: Scrape type for PN18532: 1
2026-03-27 20:35:33 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-27 20:35:33 [auto1.be] INFO: Scrape type for TE72836: 1
2026-03-27 20:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA29570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:33 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44926%27 HTTP/1.1" 200 None
2026-03-27 20:35:33 [auto1.be] INFO: Scrape type for UA44926: 2
2026-03-27 20:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70074d0-20da-5e22-8306-b38c7f838876 with identifier: UA44926
2026-03-27 20:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70074d0-20da-5e22-8306-b38c7f838876 with scrape type 2
2026-03-27 20:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d70074d0-20da-5e22-8306-b38c7f838876 with scrape type 2
2026-03-27 20:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d70074d0-20da-5e22-8306-b38c7f838876, identifier: UA44926
2026-03-27 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d70074d0-20da-5e22-8306-b38c7f838876 with identifier: UA44926
2026-03-27 20:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d70074d0-20da-5e22-8306-b38c7f838876 with identifier: UA44926
2026-03-27 20:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d70074d0-20da-5e22-8306-b38c7f838876 with identifier: UA44926 to the API
2026-03-27 20:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:21:22Z',
 'fuel_type': 'petrol',
 'id': 'd70074d0-20da-5e22-8306-b38c7f838876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA44926',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 160748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-11',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44926%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Saving data for UA44926: {'auction_closing_time': 1774714882.0, 'created_time': 1774298313.362653, 'last_price_update_time': 1774643734.163814}
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA44926') HTTP/1.1" 204 0
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Scrape type for YS75558: 0
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ37303%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Scrape type for PJ37303: 0
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Scrape type for LM02594: 0
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL48181%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Scrape type for ZL48181: 2
2026-03-27 20:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 638b6285-4720-5396-a6f5-59c2767bb5b7 with identifier: ZL48181
2026-03-27 20:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 638b6285-4720-5396-a6f5-59c2767bb5b7 with scrape type 2
2026-03-27 20:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 638b6285-4720-5396-a6f5-59c2767bb5b7 with scrape type 2
2026-03-27 20:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 638b6285-4720-5396-a6f5-59c2767bb5b7, identifier: ZL48181
2026-03-27 20:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 638b6285-4720-5396-a6f5-59c2767bb5b7 with identifier: ZL48181
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 20:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 638b6285-4720-5396-a6f5-59c2767bb5b7 with identifier: ZL48181
2026-03-27 20:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 638b6285-4720-5396-a6f5-59c2767bb5b7 with identifier: ZL48181 to the API
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:05:13Z',
 'fuel_type': 'hybrid',
 'id': '638b6285-4720-5396-a6f5-59c2767bb5b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL48181',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 65927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2021}
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL48181%27 HTTP/1.1" 200 None
2026-03-27 20:35:34 [auto1.be] INFO: Saving data for ZL48181: {'auction_closing_time': 1774713913.0, 'created_time': 1774438571.656538, 'last_price_update_time': 1774643734.889529}
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL48181') HTTP/1.1" 204 0
2026-03-27 20:35:34 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-27 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS64524%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for WS64524: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for MH10936: 0
2026-03-27 20:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN69701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:35 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1659 | hits on page: 40
2026-03-27 20:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for PB88221: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for DW77345: 1
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY53321%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for ZY53321: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN14983%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for AN14983: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY60433%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for KY60433: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV88346%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for YV88346: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX76756%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for SX76756: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN79459%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for UN79459: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD83049%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for RD83049: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64261%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for UE64261: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA02413%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for UA02413: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for PL33803: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR59169%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for GR59169: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU62289%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for EU62289: 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Scrape type for CD50328: 2
2026-03-27 20:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328
2026-03-27 20:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27845ad9-51ba-5141-9087-3ad1998081b9 with scrape type 2
2026-03-27 20:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27845ad9-51ba-5141-9087-3ad1998081b9 with scrape type 2
2026-03-27 20:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27845ad9-51ba-5141-9087-3ad1998081b9, identifier: CD50328
2026-03-27 20:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328
2026-03-27 20:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328
2026-03-27 20:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328 to the API
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:58:23Z',
 'fuel_type': 'petrol',
 'id': '27845ad9-51ba-5141-9087-3ad1998081b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD50328',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 190374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [auto1.be] INFO: Saving data for CD50328: {'auction_closing_time': 1774717103.0, 'created_time': 1773693928.615321, 'last_price_update_time': 1774643735.745834}
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD50328') HTTP/1.1" 204 0
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-27 20:35:35 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-27 20:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS47676> (referer: https://www.auto1.com/v1/car-details-view/KS47676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 208859d5-410b-54b1-b3cd-bb50d73f6299 with identifier: KS47676
2026-03-27 20:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 208859d5-410b-54b1-b3cd-bb50d73f6299 with scrape type 1
2026-03-27 20:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 208859d5-410b-54b1-b3cd-bb50d73f6299
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_b454170fc8d266cbeb1b134451c57b79.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b454170fc8d266cbeb1b134451c57b79.jpg already downloaded
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_bb3c3adc755c27a37c6ab978c18802cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_bb3c3adc755c27a37c6ab978c18802cc.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_b614d0ca6ab6eb9cad66ef2c76492037.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b614d0ca6ab6eb9cad66ef2c76492037.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_d1481a574c0b32a19c89f6e15601324f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_d1481a574c0b32a19c89f6e15601324f.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_b0593ce16003917f9b07abb4c23139a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b0593ce16003917f9b07abb4c23139a4.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_590fd877332c33623101bca536a62750.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_590fd877332c33623101bca536a62750.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_119b8bdcb984f09b5af29a8a4815fbd7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_119b8bdcb984f09b5af29a8a4815fbd7.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_360a3413e952b73b73485739cba367bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_360a3413e952b73b73485739cba367bd.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_88b40af3d741b09bfe48c3a0608db8ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_88b40af3d741b09bfe48c3a0608db8ab.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F88%252F1d882cb20e92e04b58556ec746a920c6%252Fpa%252FKS47676_0e39b6adebb89026d39d4ca0822915dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_0e39b6adebb89026d39d4ca0822915dd.jpg already downloaded
2026-03-27 20:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 208859d5-410b-54b1-b3cd-bb50d73f6299, identifier: KS47676
2026-03-27 20:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 208859d5-410b-54b1-b3cd-bb50d73f6299 with identifier: KS47676
2026-03-27 20:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 208859d5-410b-54b1-b3cd-bb50d73f6299 with identifier: KS47676
2026-03-27 20:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 208859d5-410b-54b1-b3cd-bb50d73f6299 with identifier: KS47676 to the API
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KS47676>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:41:33Z',
 'fuel_type': 'diesel',
 'id': '208859d5-410b-54b1-b3cd-bb50d73f6299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS47676',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 153510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b454170fc8d266cbeb1b134451c57b79.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_bb3c3adc755c27a37c6ab978c18802cc.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b614d0ca6ab6eb9cad66ef2c76492037.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_d1481a574c0b32a19c89f6e15601324f.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b0593ce16003917f9b07abb4c23139a4.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_590fd877332c33623101bca536a62750.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_119b8bdcb984f09b5af29a8a4815fbd7.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_360a3413e952b73b73485739cba367bd.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_88b40af3d741b09bfe48c3a0608db8ab.jpg',
                'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_0e39b6adebb89026d39d4ca0822915dd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b454170fc8d266cbeb1b134451c57b79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_bb3c3adc755c27a37c6ab978c18802cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b614d0ca6ab6eb9cad66ef2c76492037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_d1481a574c0b32a19c89f6e15601324f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_b0593ce16003917f9b07abb4c23139a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2293520,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_590fd877332c33623101bca536a62750.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_119b8bdcb984f09b5af29a8a4815fbd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_360a3413e952b73b73485739cba367bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_88b40af3d741b09bfe48c3a0608db8ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208859d5-410b-54b1-b3cd-bb50d73f6299/208859d5-410b-54b1-b3cd-bb50d73f6299_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2249860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/88/1d882cb20e92e04b58556ec746a920c6/pa/KS47676_0e39b6adebb89026d39d4ca0822915dd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS47676%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [auto1.be] INFO: Saving data for KS47676: {'created_time': 1774643736.549412, 'last_price_update_time': 1774643736.549426, 'auction_closing_time': 1774716093.0}
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KS47676') HTTP/1.1" 204 0
2026-03-27 20:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB53896> (referer: https://www.auto1.com/v1/car-details-view/TB53896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG87445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP67733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN18532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ99747> (referer: https://www.auto1.com/v1/car-details-view/PZ99747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d60ff354-36d5-5104-9a58-e84735e14780 with identifier: TB53896
2026-03-27 20:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60ff354-36d5-5104-9a58-e84735e14780 with scrape type 1
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d60ff354-36d5-5104-9a58-e84735e14780
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_ad52d0009044bb5aaffc3a8438c09e4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_ad52d0009044bb5aaffc3a8438c09e4f.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_71a4b10de79f2d0d91ac6c1608f70ab7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_71a4b10de79f2d0d91ac6c1608f70ab7.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_a69cdc19ff9feb61b4e96131ceb8cad0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_a69cdc19ff9feb61b4e96131ceb8cad0.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_d2102263807fbd86385c8950848f1443.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_d2102263807fbd86385c8950848f1443.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_fbcd3fae77e6ece38f822dd282407751.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_fbcd3fae77e6ece38f822dd282407751.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_8e4f87cfab4036f1edbac0e5ad5464f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_8e4f87cfab4036f1edbac0e5ad5464f1.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_130bfea91dd3296021bab9d0d561c6b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_130bfea91dd3296021bab9d0d561c6b6.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_c7c907fccff7697a13b9075083f51125.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_c7c907fccff7697a13b9075083f51125.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_464bb093f31afe4c11e584b8b45f4fcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_464bb093f31afe4c11e584b8b45f4fcf.jpg already downloaded
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F78%252Ff778f3881fd9ff825a819cb970c372dc%252Fpa%252FTB53896_6af3d79a78da310db6907e8a0a83172a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_6af3d79a78da310db6907e8a0a83172a.jpg already downloaded
2026-03-27 20:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d60ff354-36d5-5104-9a58-e84735e14780, identifier: TB53896
2026-03-27 20:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d60ff354-36d5-5104-9a58-e84735e14780 with identifier: TB53896
2026-03-27 20:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d60ff354-36d5-5104-9a58-e84735e14780 with identifier: TB53896
2026-03-27 20:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d60ff354-36d5-5104-9a58-e84735e14780 with identifier: TB53896 to the API
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB53896>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:17:00Z',
 'fuel_type': 'petrol',
 'id': 'd60ff354-36d5-5104-9a58-e84735e14780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB53896',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 78488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_ad52d0009044bb5aaffc3a8438c09e4f.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_71a4b10de79f2d0d91ac6c1608f70ab7.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_a69cdc19ff9feb61b4e96131ceb8cad0.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_d2102263807fbd86385c8950848f1443.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_fbcd3fae77e6ece38f822dd282407751.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_8e4f87cfab4036f1edbac0e5ad5464f1.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_130bfea91dd3296021bab9d0d561c6b6.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_c7c907fccff7697a13b9075083f51125.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_464bb093f31afe4c11e584b8b45f4fcf.jpg',
                'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_6af3d79a78da310db6907e8a0a83172a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_ad52d0009044bb5aaffc3a8438c09e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_71a4b10de79f2d0d91ac6c1608f70ab7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_a69cdc19ff9feb61b4e96131ceb8cad0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_d2102263807fbd86385c8950848f1443.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_fbcd3fae77e6ece38f822dd282407751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_8e4f87cfab4036f1edbac0e5ad5464f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_130bfea91dd3296021bab9d0d561c6b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_c7c907fccff7697a13b9075083f51125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_464bb093f31afe4c11e584b8b45f4fcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d60ff354-36d5-5104-9a58-e84735e14780/d60ff354-36d5-5104-9a58-e84735e14780_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/78/f778f3881fd9ff825a819cb970c372dc/pa/TB53896_6af3d79a78da310db6907e8a0a83172a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2015}
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB53896%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [auto1.be] INFO: Saving data for TB53896: {'created_time': 1774643737.255519, 'last_price_update_time': 1774643737.25553, 'auction_closing_time': 1774714620.0}
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TB53896') HTTP/1.1" 204 0
2026-03-27 20:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY58607> (referer: https://www.auto1.com/v1/car-details-view/PY58607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad475bb-d73f-5c70-bd2c-136839f58d43 with identifier: PZ99747
2026-03-27 20:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad475bb-d73f-5c70-bd2c-136839f58d43 with scrape type 1
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ad475bb-d73f-5c70-bd2c-136839f58d43
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_556152f012a83b8c3aa7fd8e04ff081a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_556152f012a83b8c3aa7fd8e04ff081a.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_038dfb719511f856fb49e7f2d9c29e3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_038dfb719511f856fb49e7f2d9c29e3a.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_eb8fad98b0caccd366314048f54fd1a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_eb8fad98b0caccd366314048f54fd1a1.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_88bf09d84f87e0f801ee4d624b11a117.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_88bf09d84f87e0f801ee4d624b11a117.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_6e807eaede1a28d3d3270fcdf3fe235a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_6e807eaede1a28d3d3270fcdf3fe235a.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_2267fd88a1efe91cee2d9efd395d18e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_2267fd88a1efe91cee2d9efd395d18e3.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_9f8d12751b38a8a854ffae73e2198f5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_9f8d12751b38a8a854ffae73e2198f5a.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_2d19a3206442f8f55781b69260796bd0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_2d19a3206442f8f55781b69260796bd0.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_329c3c0c46e2408d3e0dc72badd511a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_329c3c0c46e2408d3e0dc72badd511a5.jpg already downloaded
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F6275d89ad27d5f3106ea473fdb036dee%252Fpa%252FPZ99747_4be9438b0ceb102f8f15f60287beb620.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_4be9438b0ceb102f8f15f60287beb620.jpg already downloaded
2026-03-27 20:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ad475bb-d73f-5c70-bd2c-136839f58d43, identifier: PZ99747
2026-03-27 20:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ad475bb-d73f-5c70-bd2c-136839f58d43 with identifier: PZ99747
2026-03-27 20:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ad475bb-d73f-5c70-bd2c-136839f58d43 with identifier: PZ99747
2026-03-27 20:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ad475bb-d73f-5c70-bd2c-136839f58d43 with identifier: PZ99747 to the API
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PZ99747>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:46:02Z',
 'fuel_type': 'petrol',
 'id': '2ad475bb-d73f-5c70-bd2c-136839f58d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ99747',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 49349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_556152f012a83b8c3aa7fd8e04ff081a.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_038dfb719511f856fb49e7f2d9c29e3a.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_eb8fad98b0caccd366314048f54fd1a1.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_88bf09d84f87e0f801ee4d624b11a117.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_6e807eaede1a28d3d3270fcdf3fe235a.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_2267fd88a1efe91cee2d9efd395d18e3.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_9f8d12751b38a8a854ffae73e2198f5a.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_2d19a3206442f8f55781b69260796bd0.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_329c3c0c46e2408d3e0dc72badd511a5.jpg',
                'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_4be9438b0ceb102f8f15f60287beb620.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_556152f012a83b8c3aa7fd8e04ff081a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_038dfb719511f856fb49e7f2d9c29e3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_eb8fad98b0caccd366314048f54fd1a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_88bf09d84f87e0f801ee4d624b11a117.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_6e807eaede1a28d3d3270fcdf3fe235a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_2267fd88a1efe91cee2d9efd395d18e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_9f8d12751b38a8a854ffae73e2198f5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_2d19a3206442f8f55781b69260796bd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_329c3c0c46e2408d3e0dc72badd511a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ad475bb-d73f-5c70-bd2c-136839f58d43/2ad475bb-d73f-5c70-bd2c-136839f58d43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/6275d89ad27d5f3106ea473fdb036dee/pa/PZ99747_4be9438b0ceb102f8f15f60287beb620.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B5 Mild-Hybrid R Design 2WD',
 'transmission': 'automatic',
 'trim': 'R Design 2WD',
 'year': 2020}
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ99747%27 HTTP/1.1" 200 None
2026-03-27 20:35:37 [auto1.be] INFO: Saving data for PZ99747: {'created_time': 1774643737.973456, 'last_price_update_time': 1774643737.973467, 'auction_closing_time': 1774716362.0}
2026-03-27 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ99747') HTTP/1.1" 204 0
2026-03-27 20:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC85996> (referer: https://www.auto1.com/v1/car-details-view/XC85996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-27 20:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26bf0e1-cb66-5112-9cb6-b13a24f193db with scrape type 1
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d26bf0e1-cb66-5112-9cb6-b13a24f193db
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_51492df68a2ae97df0a6077d7e91c235.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_51492df68a2ae97df0a6077d7e91c235.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_eebb0f1406982d4e3a5455dc4dccc045.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_eebb0f1406982d4e3a5455dc4dccc045.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_568b566ca528526c19635652eb590e1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_568b566ca528526c19635652eb590e1b.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_900091e52b3f8a8ac1751820631a89d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_900091e52b3f8a8ac1751820631a89d8.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_e50721266f54ccb7135b67a0f14e734c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_e50721266f54ccb7135b67a0f14e734c.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_b10baeb7351a25fd4a0c8ffddc9a2ae1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_b10baeb7351a25fd4a0c8ffddc9a2ae1.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_edf78e840132c28e9e2fd33b4942e78a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_edf78e840132c28e9e2fd33b4942e78a.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_6bdcd339e5f6e23baf3f082c3d566512.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_6bdcd339e5f6e23baf3f082c3d566512.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_5c6edebeedf2612b9137ffaa8aecb85e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_5c6edebeedf2612b9137ffaa8aecb85e.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fed%252Faeed41264881881f295893dc0580d818%252Fpa%252FPY58607_92cdb2f6f212793d05a2b6003524d121.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_92cdb2f6f212793d05a2b6003524d121.jpg already downloaded
2026-03-27 20:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d26bf0e1-cb66-5112-9cb6-b13a24f193db, identifier: PY58607
2026-03-27 20:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-27 20:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-27 20:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607 to the API
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PY58607>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:13:20Z',
 'fuel_type': 'diesel',
 'id': 'd26bf0e1-cb66-5112-9cb6-b13a24f193db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY58607',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 155326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_51492df68a2ae97df0a6077d7e91c235.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_eebb0f1406982d4e3a5455dc4dccc045.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_568b566ca528526c19635652eb590e1b.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_900091e52b3f8a8ac1751820631a89d8.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_e50721266f54ccb7135b67a0f14e734c.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_b10baeb7351a25fd4a0c8ffddc9a2ae1.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_edf78e840132c28e9e2fd33b4942e78a.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_6bdcd339e5f6e23baf3f082c3d566512.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_5c6edebeedf2612b9137ffaa8aecb85e.jpg',
                'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_92cdb2f6f212793d05a2b6003524d121.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778230,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_51492df68a2ae97df0a6077d7e91c235.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_eebb0f1406982d4e3a5455dc4dccc045.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_568b566ca528526c19635652eb590e1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2212327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_900091e52b3f8a8ac1751820631a89d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_e50721266f54ccb7135b67a0f14e734c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2575592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_b10baeb7351a25fd4a0c8ffddc9a2ae1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_edf78e840132c28e9e2fd33b4942e78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2334010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_6bdcd339e5f6e23baf3f082c3d566512.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_5c6edebeedf2612b9137ffaa8aecb85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26bf0e1-cb66-5112-9cb6-b13a24f193db/d26bf0e1-cb66-5112-9cb6-b13a24f193db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2369358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ed/aeed41264881881f295893dc0580d818/pa/PY58607_92cdb2f6f212793d05a2b6003524d121.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Standard',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Standard',
 'year': 2015}
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [auto1.be] INFO: Saving data for PY58607: {'created_time': 1774643738.700245, 'last_price_update_time': 1774643738.700255, 'auction_closing_time': 1774714400.0}
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY58607') HTTP/1.1" 204 0
2026-03-27 20:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU41446> (referer: https://www.auto1.com/v1/car-details-view/AU41446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE72836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW77345/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7722eb1e-b816-5650-84f7-0b78bb91c7c8 with identifier: XC85996
2026-03-27 20:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7722eb1e-b816-5650-84f7-0b78bb91c7c8 with scrape type 1
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7722eb1e-b816-5650-84f7-0b78bb91c7c8
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_7b11e274c813c6c97bcca4a59a33671a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_7b11e274c813c6c97bcca4a59a33671a.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_892809c6ff185b2cc2301b75390a7d34.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_892809c6ff185b2cc2301b75390a7d34.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_f95a9d4432aa0eb83ce2742ee9b5480d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_f95a9d4432aa0eb83ce2742ee9b5480d.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_15a3a6571dab48fa5f58e284134ae357.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_15a3a6571dab48fa5f58e284134ae357.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_9c4a5679ef0f0d39147986f9c047e390.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_9c4a5679ef0f0d39147986f9c047e390.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_e5f2507a07e113750a12c7d817efa90d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_e5f2507a07e113750a12c7d817efa90d.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_bef8e898282059d8b1c22db7cb19d967.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_bef8e898282059d8b1c22db7cb19d967.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_3a9a01977fb8818b13d2821796270bb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_3a9a01977fb8818b13d2821796270bb3.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_d44762ebfbc41fbfa5d6c902f4dcb5d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_d44762ebfbc41fbfa5d6c902f4dcb5d3.jpg already downloaded
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F22%252F7b22d61419a1f2428a025dee5185aa37%252Fpa%252FXC85996_4ee75aa12d07984dcdcd11549c2ed001.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_4ee75aa12d07984dcdcd11549c2ed001.jpg already downloaded
2026-03-27 20:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7722eb1e-b816-5650-84f7-0b78bb91c7c8, identifier: XC85996
2026-03-27 20:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7722eb1e-b816-5650-84f7-0b78bb91c7c8 with identifier: XC85996
2026-03-27 20:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7722eb1e-b816-5650-84f7-0b78bb91c7c8 with identifier: XC85996
2026-03-27 20:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7722eb1e-b816-5650-84f7-0b78bb91c7c8 with identifier: XC85996 to the API
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC85996>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:34:17Z',
 'fuel_type': 'diesel',
 'id': '7722eb1e-b816-5650-84f7-0b78bb91c7c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC85996',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 151376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_7b11e274c813c6c97bcca4a59a33671a.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_892809c6ff185b2cc2301b75390a7d34.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_f95a9d4432aa0eb83ce2742ee9b5480d.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_15a3a6571dab48fa5f58e284134ae357.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_9c4a5679ef0f0d39147986f9c047e390.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_e5f2507a07e113750a12c7d817efa90d.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_bef8e898282059d8b1c22db7cb19d967.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_3a9a01977fb8818b13d2821796270bb3.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_d44762ebfbc41fbfa5d6c902f4dcb5d3.jpg',
                'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_4ee75aa12d07984dcdcd11549c2ed001.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_7b11e274c813c6c97bcca4a59a33671a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_892809c6ff185b2cc2301b75390a7d34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_f95a9d4432aa0eb83ce2742ee9b5480d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_15a3a6571dab48fa5f58e284134ae357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_9c4a5679ef0f0d39147986f9c047e390.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_e5f2507a07e113750a12c7d817efa90d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_bef8e898282059d8b1c22db7cb19d967.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_3a9a01977fb8818b13d2821796270bb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_d44762ebfbc41fbfa5d6c902f4dcb5d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722eb1e-b816-5650-84f7-0b78bb91c7c8/7722eb1e-b816-5650-84f7-0b78bb91c7c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/22/7b22d61419a1f2428a025dee5185aa37/pa/XC85996_4ee75aa12d07984dcdcd11549c2ed001.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy GT-Line',
 'transmission': 'manual',
 'trim': 'GT-Line',
 'year': 2017}
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC85996%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [auto1.be] INFO: Saving data for XC85996: {'created_time': 1774643739.316409, 'last_price_update_time': 1774643739.316419, 'auction_closing_time': 1774715657.0}
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC85996') HTTP/1.1" 204 0
2026-03-27 20:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA29570> (referer: https://www.auto1.com/v1/car-details-view/XA29570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN69701> (referer: https://www.auto1.com/v1/car-details-view/NN69701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-27 20:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with scrape type 1
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_53fbf19ddc03c2194e1da6b4413bf8ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_53fbf19ddc03c2194e1da6b4413bf8ef.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_6563d9eb553c53a3349364ea6b71a903.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_6563d9eb553c53a3349364ea6b71a903.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_fea0940b95e43942b7369af0385c2911.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_fea0940b95e43942b7369af0385c2911.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_cfe610223525aa397e0873910d718e97.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_cfe610223525aa397e0873910d718e97.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_2f6f1a80b0961e4f4697d5a48e972607.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_2f6f1a80b0961e4f4697d5a48e972607.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_ff1d5205e5cb03868d5aaa89c1d63c3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_ff1d5205e5cb03868d5aaa89c1d63c3f.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_564a13a27f509980ecdba4a11fd5ebea.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_564a13a27f509980ecdba4a11fd5ebea.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_a6aebdf9a68d1965683e2c139c749ff3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_a6aebdf9a68d1965683e2c139c749ff3.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_cd011d8c4da92cd182541894aeef6f43.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_cd011d8c4da92cd182541894aeef6f43.jpg already downloaded
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F35%252F8a35d4049ede0fb80f65e6ce06c86f77%252Fpa%252FAU41446_e3001e4365ecfa70e7d5b5cc63ed53ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_e3001e4365ecfa70e7d5b5cc63ed53ae.jpg already downloaded
2026-03-27 20:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6, identifier: AU41446
2026-03-27 20:35:39 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1659 | hits on page: 40
2026-03-27 20:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-27 20:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-27 20:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446 to the API
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AU41446>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 2',
 'engine': '3.2L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:10:31Z',
 'fuel_type': 'petrol',
 'id': '78ea3ef9-b77e-5939-adfa-5f613fe9d2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU41446',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 100071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_53fbf19ddc03c2194e1da6b4413bf8ef.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_6563d9eb553c53a3349364ea6b71a903.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_fea0940b95e43942b7369af0385c2911.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_cfe610223525aa397e0873910d718e97.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_2f6f1a80b0961e4f4697d5a48e972607.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_ff1d5205e5cb03868d5aaa89c1d63c3f.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_564a13a27f509980ecdba4a11fd5ebea.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_a6aebdf9a68d1965683e2c139c749ff3.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_cd011d8c4da92cd182541894aeef6f43.jpg',
                'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_e3001e4365ecfa70e7d5b5cc63ed53ae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2177957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_53fbf19ddc03c2194e1da6b4413bf8ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2127344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_6563d9eb553c53a3349364ea6b71a903.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_fea0940b95e43942b7369af0385c2911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_cfe610223525aa397e0873910d718e97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2057180,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_2f6f1a80b0961e4f4697d5a48e972607.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_ff1d5205e5cb03868d5aaa89c1d63c3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2263535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_564a13a27f509980ecdba4a11fd5ebea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_a6aebdf9a68d1965683e2c139c749ff3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2217461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_cd011d8c4da92cd182541894aeef6f43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78ea3ef9-b77e-5939-adfa-5f613fe9d2b6/78ea3ef9-b77e-5939-adfa-5f613fe9d2b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/35/8a35d4049ede0fb80f65e6ce06c86f77/pa/AU41446_e3001e4365ecfa70e7d5b5cc63ed53ae.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1992-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse 300 SE',
 'transmission': 'automatic',
 'trim': '',
 'year': 1992}
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [auto1.be] INFO: Saving data for AU41446: {'created_time': 1774643739.900579, 'last_price_update_time': 1774643739.900589, 'auction_closing_time': 1774714231.0}
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU41446') HTTP/1.1" 204 0
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF40273%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [auto1.be] INFO: Scrape type for YF40273: 0
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-27 20:35:39 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-27 20:35:39 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-27 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH30418%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Scrape type for KH30418: 0
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX63098%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Scrape type for KX63098: 2
2026-03-27 20:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8751eb7c-4e92-5743-885c-17d97d4499e8 with identifier: KX63098
2026-03-27 20:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8751eb7c-4e92-5743-885c-17d97d4499e8 with scrape type 2
2026-03-27 20:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8751eb7c-4e92-5743-885c-17d97d4499e8 with scrape type 2
2026-03-27 20:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8751eb7c-4e92-5743-885c-17d97d4499e8, identifier: KX63098
2026-03-27 20:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8751eb7c-4e92-5743-885c-17d97d4499e8 with identifier: KX63098
2026-03-27 20:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8751eb7c-4e92-5743-885c-17d97d4499e8 with identifier: KX63098
2026-03-27 20:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8751eb7c-4e92-5743-885c-17d97d4499e8 with identifier: KX63098 to the API
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:34Z',
 'fuel_type': 'petrol',
 'id': '8751eb7c-4e92-5743-885c-17d97d4499e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX63098',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 74634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX63098%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Saving data for KX63098: {'auction_closing_time': 1774716694.0, 'created_time': 1773520553.708083, 'last_price_update_time': 1774643740.370312}
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX63098') HTTP/1.1" 204 0
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK71488%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Scrape type for CK71488: 0
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-27 20:35:40 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR44504%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Scrape type for MR44504: 2
2026-03-27 20:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4878b731-9d7c-501b-b6e3-9ef88529f430 with identifier: MR44504
2026-03-27 20:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4878b731-9d7c-501b-b6e3-9ef88529f430 with scrape type 2
2026-03-27 20:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4878b731-9d7c-501b-b6e3-9ef88529f430 with scrape type 2
2026-03-27 20:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4878b731-9d7c-501b-b6e3-9ef88529f430, identifier: MR44504
2026-03-27 20:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4878b731-9d7c-501b-b6e3-9ef88529f430 with identifier: MR44504
2026-03-27 20:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4878b731-9d7c-501b-b6e3-9ef88529f430 with identifier: MR44504
2026-03-27 20:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4878b731-9d7c-501b-b6e3-9ef88529f430 with identifier: MR44504 to the API
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:53:15Z',
 'fuel_type': 'diesel',
 'id': '4878b731-9d7c-501b-b6e3-9ef88529f430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR44504',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 271868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2015}
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR44504%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [auto1.be] INFO: Saving data for MR44504: {'auction_closing_time': 1774716795.0, 'created_time': 1773434524.500865, 'last_price_update_time': 1774643740.913231}
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR44504') HTTP/1.1" 204 0
2026-03-27 20:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN18532> (referer: https://www.auto1.com/v1/car-details-view/PN18532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP67733> (referer: https://www.auto1.com/v1/car-details-view/JP67733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-27 20:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72aa8770-46dd-5579-ac2c-097dda213bac with scrape type 1
2026-03-27 20:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72aa8770-46dd-5579-ac2c-097dda213bac
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_abcb39b8d5b55ae3103cfdd717e617e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_abcb39b8d5b55ae3103cfdd717e617e1.jpg already downloaded
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_813146c209ed5b6850ae0d299cade5a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_813146c209ed5b6850ae0d299cade5a2.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_5ace2f812ade41d22a1c4d077fcf7297.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_5ace2f812ade41d22a1c4d077fcf7297.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_fce27363d648c942225f05b2c90c500b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_fce27363d648c942225f05b2c90c500b.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_0b1f251dba50d9b21ab0c30a78b434e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_0b1f251dba50d9b21ab0c30a78b434e0.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_7f18df62c711bfacc0f1598c7c210690.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_7f18df62c711bfacc0f1598c7c210690.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_f51de5d6c0f36019dbe11f028767e820.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_f51de5d6c0f36019dbe11f028767e820.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_b8c03c5d67058c914929a37b534d92ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_b8c03c5d67058c914929a37b534d92ca.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_e0d06697a90018118f9d7f9c9bd41408.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_e0d06697a90018118f9d7f9c9bd41408.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F74%252F7a7463ad7ac3e305eb249c4628f82fc6%252Fpa%252FXA29570_d531caad1f559a0f7645ff8b1e1fc70d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_d531caad1f559a0f7645ff8b1e1fc70d.jpg already downloaded
2026-03-27 20:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 72aa8770-46dd-5579-ac2c-097dda213bac, identifier: XA29570
2026-03-27 20:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-27 20:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e9cd131-57c2-59bf-959c-55bb706fbfcd with scrape type 1
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e9cd131-57c2-59bf-959c-55bb706fbfcd
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_99567c07661b83550bf1584d58439177.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_99567c07661b83550bf1584d58439177.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_8ed70a3a8621626d3d7c10fa3023cd59.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_8ed70a3a8621626d3d7c10fa3023cd59.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_23b96269fa42613feab28f9dd0d50634.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_23b96269fa42613feab28f9dd0d50634.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_7eba594f70271f183d04be9009f05f31.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_7eba594f70271f183d04be9009f05f31.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_a5f71e2b93d4f7e4d995aa0134d9a654.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_a5f71e2b93d4f7e4d995aa0134d9a654.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_7b1edcbc8eaa13e88a1a2a7646b4ad07.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_7b1edcbc8eaa13e88a1a2a7646b4ad07.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_e44ef0efcfd8898f685c0ce6d97b4520.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_e44ef0efcfd8898f685c0ce6d97b4520.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_b177fc4867fcc015fa04d7210f398262.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_b177fc4867fcc015fa04d7210f398262.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_ea2061581bef985fef50b7fbdaa05bd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_ea2061581bef985fef50b7fbdaa05bd8.jpg already downloaded
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fbb%252F2cbb10fb86ffb2320ad73ab68868c21f%252Fpa%252FNN69701_80b0ebbc9177b4190ec3fee41bf2b13e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_80b0ebbc9177b4190ec3fee41bf2b13e.jpg already downloaded
2026-03-27 20:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e9cd131-57c2-59bf-959c-55bb706fbfcd, identifier: NN69701
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU20603%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [auto1.be] INFO: Scrape type for BU20603: 0
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [auto1.be] INFO: Scrape type for LT82149: 0
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-27 20:35:41 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF99667%27 HTTP/1.1" 200 None
2026-03-27 20:35:41 [auto1.be] INFO: Scrape type for VF99667: 2
2026-03-27 20:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54fc3732-48e4-5130-adcf-3efe700dc012 with identifier: VF99667
2026-03-27 20:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54fc3732-48e4-5130-adcf-3efe700dc012 with scrape type 2
2026-03-27 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54fc3732-48e4-5130-adcf-3efe700dc012 with scrape type 2
2026-03-27 20:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54fc3732-48e4-5130-adcf-3efe700dc012, identifier: VF99667
2026-03-27 20:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 20:35:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-27 20:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570 to the API
2026-03-27 20:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XA29570>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:40Z',
 'fuel_type': 'petrol',
 'id': '72aa8770-46dd-5579-ac2c-097dda213bac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA29570',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 101998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_abcb39b8d5b55ae3103cfdd717e617e1.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_813146c209ed5b6850ae0d299cade5a2.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_5ace2f812ade41d22a1c4d077fcf7297.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_fce27363d648c942225f05b2c90c500b.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_0b1f251dba50d9b21ab0c30a78b434e0.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_7f18df62c711bfacc0f1598c7c210690.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_f51de5d6c0f36019dbe11f028767e820.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_b8c03c5d67058c914929a37b534d92ca.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_e0d06697a90018118f9d7f9c9bd41408.jpg',
                'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_d531caad1f559a0f7645ff8b1e1fc70d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_abcb39b8d5b55ae3103cfdd717e617e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_813146c209ed5b6850ae0d299cade5a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_5ace2f812ade41d22a1c4d077fcf7297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_fce27363d648c942225f05b2c90c500b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_0b1f251dba50d9b21ab0c30a78b434e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_7f18df62c711bfacc0f1598c7c210690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_f51de5d6c0f36019dbe11f028767e820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2089805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_b8c03c5d67058c914929a37b534d92ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_e0d06697a90018118f9d7f9c9bd41408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72aa8770-46dd-5579-ac2c-097dda213bac/72aa8770-46dd-5579-ac2c-097dda213bac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/74/7a7463ad7ac3e305eb249c4628f82fc6/pa/XA29570_d531caad1f559a0f7645ff8b1e1fc70d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [auto1.be] INFO: Saving data for XA29570: {'created_time': 1774643742.128975, 'last_price_update_time': 1774643742.128991, 'auction_closing_time': 1774714360.0}
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XA29570') HTTP/1.1" 204 0
2026-03-27 20:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-27 20:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-27 20:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701 to the API
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN69701>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:05:13Z',
 'fuel_type': 'diesel',
 'id': '7e9cd131-57c2-59bf-959c-55bb706fbfcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN69701',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 207612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_99567c07661b83550bf1584d58439177.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_8ed70a3a8621626d3d7c10fa3023cd59.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_23b96269fa42613feab28f9dd0d50634.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_7eba594f70271f183d04be9009f05f31.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_a5f71e2b93d4f7e4d995aa0134d9a654.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_7b1edcbc8eaa13e88a1a2a7646b4ad07.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_e44ef0efcfd8898f685c0ce6d97b4520.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_b177fc4867fcc015fa04d7210f398262.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_ea2061581bef985fef50b7fbdaa05bd8.jpg',
                'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_80b0ebbc9177b4190ec3fee41bf2b13e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3206031,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_99567c07661b83550bf1584d58439177.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3243408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_8ed70a3a8621626d3d7c10fa3023cd59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_23b96269fa42613feab28f9dd0d50634.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3199813,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_7eba594f70271f183d04be9009f05f31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_a5f71e2b93d4f7e4d995aa0134d9a654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_7b1edcbc8eaa13e88a1a2a7646b4ad07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_e44ef0efcfd8898f685c0ce6d97b4520.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_b177fc4867fcc015fa04d7210f398262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_ea2061581bef985fef50b7fbdaa05bd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e9cd131-57c2-59bf-959c-55bb706fbfcd/7e9cd131-57c2-59bf-959c-55bb706fbfcd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3431255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/bb/2cbb10fb86ffb2320ad73ab68868c21f/pa/NN69701_80b0ebbc9177b4190ec3fee41bf2b13e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [auto1.be] INFO: Saving data for NN69701: {'created_time': 1774643742.489224, 'last_price_update_time': 1774643742.489234, 'auction_closing_time': 1774713913.0}
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN69701') HTTP/1.1" 204 0
2026-03-27 20:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54fc3732-48e4-5130-adcf-3efe700dc012 with identifier: VF99667
2026-03-27 20:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54fc3732-48e4-5130-adcf-3efe700dc012 with identifier: VF99667
2026-03-27 20:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54fc3732-48e4-5130-adcf-3efe700dc012 with identifier: VF99667 to the API
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:43:01Z',
 'fuel_type': 'petrol',
 'id': '54fc3732-48e4-5130-adcf-3efe700dc012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF99667',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 193432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-16',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF99667%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [auto1.be] INFO: Saving data for VF99667: {'auction_closing_time': 1774716181.0, 'created_time': 1773834446.206936, 'last_price_update_time': 1774643742.768441}
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VF99667') HTTP/1.1" 204 0
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF90058%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [auto1.be] INFO: Scrape type for XF90058: 0
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-27 20:35:42 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG55963%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [auto1.be] INFO: Scrape type for WG55963: 0
2026-03-27 20:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG87445> (referer: https://www.auto1.com/v1/car-details-view/AG87445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-27 20:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e81558-43ae-5478-9dee-39cbb0b045e4 with scrape type 1
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25e81558-43ae-5478-9dee-39cbb0b045e4
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_768eb0467f8ed0e16e31f6109dffc2bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_768eb0467f8ed0e16e31f6109dffc2bd.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_693a1d788121631d7f3879c70f510abe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_693a1d788121631d7f3879c70f510abe.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_548373499feae430ce526a8d2bd1c475.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_548373499feae430ce526a8d2bd1c475.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_4fa12926f3c8b95dac309c91961631e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_4fa12926f3c8b95dac309c91961631e6.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_bf0556af9c5d4d9f32639022648d7fd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_bf0556af9c5d4d9f32639022648d7fd5.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_34a95f47be11e3368480303fae789190.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_34a95f47be11e3368480303fae789190.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_89a18b2fa9bc37b0f53e3a32937012db.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_89a18b2fa9bc37b0f53e3a32937012db.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_01819134b540a6c422a6b4464ce8e1cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_01819134b540a6c422a6b4464ce8e1cf.jpg already downloaded
2026-03-27 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_e44286a1bb5dcdf693b841a67000cbac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_e44286a1bb5dcdf693b841a67000cbac.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F0c%252F4d0c3fb45f99a94b8cd262033f1915c8%252Fpa%252FPN18532_e56badb80fd0520a9bf53765476c9139.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_e56badb80fd0520a9bf53765476c9139.jpg already downloaded
2026-03-27 20:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25e81558-43ae-5478-9dee-39cbb0b045e4, identifier: PN18532
2026-03-27 20:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-27 20:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba092004-345f-5dc4-93eb-fb7dd27a70dd with scrape type 1
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba092004-345f-5dc4-93eb-fb7dd27a70dd
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_300a485ee55f10b1d99704440266ec6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_300a485ee55f10b1d99704440266ec6d.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_0121b052c8f1570d618c0ea741df5eef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_0121b052c8f1570d618c0ea741df5eef.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_96c0dcec4ad87c788757a1f5d012c37a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_96c0dcec4ad87c788757a1f5d012c37a.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_dddbbe534dee83a53671441d3d742110.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_dddbbe534dee83a53671441d3d742110.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_1deca43db8782693aaea48fa79a29cda.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_1deca43db8782693aaea48fa79a29cda.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_4c2ae4fdcf92b8d73cd2d05011ab78dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_4c2ae4fdcf92b8d73cd2d05011ab78dd.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_f5021a2db1a3d3a57e6ff722052e90b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_f5021a2db1a3d3a57e6ff722052e90b8.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_8f5bc568d7babb5328fba88a2d610722.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_8f5bc568d7babb5328fba88a2d610722.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_a2078b7bc16b6583aaf9488f1a37da2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_a2078b7bc16b6583aaf9488f1a37da2b.jpg already downloaded
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F20%252F0720a6bdba2d467566e16aa12c5db465%252Fpa%252FJP67733_a3eb576334a7ab0237c6c79146675bb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_a3eb576334a7ab0237c6c79146675bb8.jpg already downloaded
2026-03-27 20:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba092004-345f-5dc4-93eb-fb7dd27a70dd, identifier: JP67733
2026-03-27 20:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-27 20:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532
2026-03-27 20:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25e81558-43ae-5478-9dee-39cbb0b045e4 with identifier: PN18532 to the API
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PN18532>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:43:53Z',
 'fuel_type': 'petrol',
 'id': '25e81558-43ae-5478-9dee-39cbb0b045e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN18532',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 100802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_768eb0467f8ed0e16e31f6109dffc2bd.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_693a1d788121631d7f3879c70f510abe.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_548373499feae430ce526a8d2bd1c475.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_4fa12926f3c8b95dac309c91961631e6.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_bf0556af9c5d4d9f32639022648d7fd5.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_34a95f47be11e3368480303fae789190.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_89a18b2fa9bc37b0f53e3a32937012db.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_01819134b540a6c422a6b4464ce8e1cf.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_e44286a1bb5dcdf693b841a67000cbac.jpg',
                'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_e56badb80fd0520a9bf53765476c9139.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_768eb0467f8ed0e16e31f6109dffc2bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_693a1d788121631d7f3879c70f510abe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_548373499feae430ce526a8d2bd1c475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_4fa12926f3c8b95dac309c91961631e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_bf0556af9c5d4d9f32639022648d7fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_34a95f47be11e3368480303fae789190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_89a18b2fa9bc37b0f53e3a32937012db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_01819134b540a6c422a6b4464ce8e1cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_e44286a1bb5dcdf693b841a67000cbac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25e81558-43ae-5478-9dee-39cbb0b045e4/25e81558-43ae-5478-9dee-39cbb0b045e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/0c/4d0c3fb45f99a94b8cd262033f1915c8/pa/PN18532_e56badb80fd0520a9bf53765476c9139.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-27 20:35:43 [auto1.be] INFO: Saving data for PN18532: {'created_time': 1774643743.681616, 'last_price_update_time': 1774643743.681626, 'auction_closing_time': 1774716233.0}
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PN18532') HTTP/1.1" 204 0
2026-03-27 20:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-27 20:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-27 20:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733 to the API
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JP67733>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:21:47Z',
 'fuel_type': 'hybrid',
 'id': 'ba092004-345f-5dc4-93eb-fb7dd27a70dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP67733',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 185798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_300a485ee55f10b1d99704440266ec6d.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_0121b052c8f1570d618c0ea741df5eef.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_96c0dcec4ad87c788757a1f5d012c37a.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_dddbbe534dee83a53671441d3d742110.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_1deca43db8782693aaea48fa79a29cda.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_4c2ae4fdcf92b8d73cd2d05011ab78dd.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_f5021a2db1a3d3a57e6ff722052e90b8.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_8f5bc568d7babb5328fba88a2d610722.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_a2078b7bc16b6583aaf9488f1a37da2b.jpg',
                'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_a3eb576334a7ab0237c6c79146675bb8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_300a485ee55f10b1d99704440266ec6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_0121b052c8f1570d618c0ea741df5eef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_96c0dcec4ad87c788757a1f5d012c37a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_dddbbe534dee83a53671441d3d742110.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_1deca43db8782693aaea48fa79a29cda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_4c2ae4fdcf92b8d73cd2d05011ab78dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552019,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_f5021a2db1a3d3a57e6ff722052e90b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2607117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_8f5bc568d7babb5328fba88a2d610722.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_a2078b7bc16b6583aaf9488f1a37da2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba092004-345f-5dc4-93eb-fb7dd27a70dd/ba092004-345f-5dc4-93eb-fb7dd27a70dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/20/0720a6bdba2d467566e16aa12c5db465/pa/JP67733_a3eb576334a7ab0237c6c79146675bb8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 Hybrid BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'BlueTEC Elegance',
 'year': 2015}
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [auto1.be] INFO: Saving data for JP67733: {'created_time': 1774643744.04436, 'last_price_update_time': 1774643744.044369, 'auction_closing_time': 1774714907.0}
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JP67733') HTTP/1.1" 204 0
2026-03-27 20:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-27 20:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5b75cb-574d-5037-83d7-0dd641cabc89 with scrape type 1
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d5b75cb-574d-5037-83d7-0dd641cabc89
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_c63a5cad05d646307444a3d0b799d587.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_c63a5cad05d646307444a3d0b799d587.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_a6d4371e639e620cc2d8980df24b1b71.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_a6d4371e639e620cc2d8980df24b1b71.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_5094b5b349f8ec18b5dedea3dc1d4ba1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_5094b5b349f8ec18b5dedea3dc1d4ba1.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_84f95bf3cea2bfd741ae4cda639c0366.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_84f95bf3cea2bfd741ae4cda639c0366.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_e71723de5b7de3ba0a2238d924ea945e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_e71723de5b7de3ba0a2238d924ea945e.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_1ae9afde52e9867666515fce13f99a24.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_1ae9afde52e9867666515fce13f99a24.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_d92a556a98bf3daf07114b4530419592.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_d92a556a98bf3daf07114b4530419592.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_22e278e6daee69089f82d464553d82f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_22e278e6daee69089f82d464553d82f1.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_48d91441177c178a4c6c902807652f56.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_48d91441177c178a4c6c902807652f56.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F64%252F8664671a2c78f8e7dd716826ce455fce%252Fpa%252FAG87445_9007fce4690c17fea5e8abe26f970e68.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_9007fce4690c17fea5e8abe26f970e68.jpg already downloaded
2026-03-27 20:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d5b75cb-574d-5037-83d7-0dd641cabc89, identifier: AG87445
2026-03-27 20:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-27 20:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-27 20:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445 to the API
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AG87445>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:27:20Z',
 'fuel_type': 'diesel',
 'id': '9d5b75cb-574d-5037-83d7-0dd641cabc89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG87445',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 296960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_c63a5cad05d646307444a3d0b799d587.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_a6d4371e639e620cc2d8980df24b1b71.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_5094b5b349f8ec18b5dedea3dc1d4ba1.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_84f95bf3cea2bfd741ae4cda639c0366.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_e71723de5b7de3ba0a2238d924ea945e.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_1ae9afde52e9867666515fce13f99a24.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_d92a556a98bf3daf07114b4530419592.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_22e278e6daee69089f82d464553d82f1.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_48d91441177c178a4c6c902807652f56.jpg',
                'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_9007fce4690c17fea5e8abe26f970e68.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_c63a5cad05d646307444a3d0b799d587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_a6d4371e639e620cc2d8980df24b1b71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_5094b5b349f8ec18b5dedea3dc1d4ba1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_84f95bf3cea2bfd741ae4cda639c0366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_e71723de5b7de3ba0a2238d924ea945e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_1ae9afde52e9867666515fce13f99a24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_d92a556a98bf3daf07114b4530419592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_22e278e6daee69089f82d464553d82f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_48d91441177c178a4c6c902807652f56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b75cb-574d-5037-83d7-0dd641cabc89/9d5b75cb-574d-5037-83d7-0dd641cabc89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/64/8664671a2c78f8e7dd716826ce455fce/pa/AG87445_9007fce4690c17fea5e8abe26f970e68.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L2 Limited',
 'transmission': 'automatic',
 'trim': '320 L2 Limited',
 'year': 2021}
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [auto1.be] INFO: Saving data for AG87445: {'created_time': 1774643744.61289, 'last_price_update_time': 1774643744.612899, 'auction_closing_time': 1774715240.0}
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG87445') HTTP/1.1" 204 0
2026-03-27 20:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW77345> (referer: https://www.auto1.com/v1/car-details-view/DW77345/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE72836> (referer: https://www.auto1.com/v1/car-details-view/TE72836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:35:44 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1659 | hits on page: 40
2026-03-27 20:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-27 20:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66551045-57ae-5a77-b829-e167b3a9ebfb with scrape type 1
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66551045-57ae-5a77-b829-e167b3a9ebfb
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_d159d2938449057e2636d5586046668c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_d159d2938449057e2636d5586046668c.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_b6e2997b68f0a16795a445ddebe1afa5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_b6e2997b68f0a16795a445ddebe1afa5.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_3ca2533166191ece5b6b5745dac019f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_3ca2533166191ece5b6b5745dac019f8.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_1043a8d0128d616b30bb0167ac264135.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_1043a8d0128d616b30bb0167ac264135.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_181702db59015c26cf15c765af689917.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_181702db59015c26cf15c765af689917.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_9a68b958653956bd35be3bf404446914.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_9a68b958653956bd35be3bf404446914.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_6b2ec81b9d7885215621757e9027be96.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_6b2ec81b9d7885215621757e9027be96.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_940ae271db9422e29234e8a63804068f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_940ae271db9422e29234e8a63804068f.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_2fd8023b790f7bc1a4bf7ccc60684dbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_2fd8023b790f7bc1a4bf7ccc60684dbe.jpg already downloaded
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fa8%252F22a8ba521d1fa883fe2676662d4ed5a0%252Fpa%252FDW77345_cd7ca6de42da6d5dee3234c6a12038a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_cd7ca6de42da6d5dee3234c6a12038a6.jpg already downloaded
2026-03-27 20:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66551045-57ae-5a77-b829-e167b3a9ebfb, identifier: DW77345
2026-03-27 20:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-27 20:35:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345
2026-03-27 20:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66551045-57ae-5a77-b829-e167b3a9ebfb with identifier: DW77345 to the API
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DW77345>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:47:51Z',
 'fuel_type': 'diesel',
 'id': '66551045-57ae-5a77-b829-e167b3a9ebfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77345',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Terrano',
 'odometer': 133405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_d159d2938449057e2636d5586046668c.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_b6e2997b68f0a16795a445ddebe1afa5.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_3ca2533166191ece5b6b5745dac019f8.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_1043a8d0128d616b30bb0167ac264135.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_181702db59015c26cf15c765af689917.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_9a68b958653956bd35be3bf404446914.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_6b2ec81b9d7885215621757e9027be96.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_940ae271db9422e29234e8a63804068f.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_2fd8023b790f7bc1a4bf7ccc60684dbe.jpg',
                'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_cd7ca6de42da6d5dee3234c6a12038a6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_d159d2938449057e2636d5586046668c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_b6e2997b68f0a16795a445ddebe1afa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_3ca2533166191ece5b6b5745dac019f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_1043a8d0128d616b30bb0167ac264135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_181702db59015c26cf15c765af689917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_9a68b958653956bd35be3bf404446914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_6b2ec81b9d7885215621757e9027be96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_940ae271db9422e29234e8a63804068f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_2fd8023b790f7bc1a4bf7ccc60684dbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66551045-57ae-5a77-b829-e167b3a9ebfb/66551045-57ae-5a77-b829-e167b3a9ebfb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/a8/22a8ba521d1fa883fe2676662d4ed5a0/pa/DW77345_cd7ca6de42da6d5dee3234c6a12038a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-03-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Nissan Terrano 3.0 TD Outdoor',
 'transmission': 'automatic',
 'trim': 'Outdoor',
 'year': 2006}
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-27 20:35:45 [auto1.be] INFO: Saving data for DW77345: {'created_time': 1774643745.435627, 'last_price_update_time': 1774643745.435641, 'auction_closing_time': 1774716471.0}
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW77345') HTTP/1.1" 204 0
2026-03-27 20:35:45 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-27 20:35:45 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK47918%27 HTTP/1.1" 200 None
2026-03-27 20:35:45 [auto1.be] INFO: Scrape type for LK47918: 0
2026-03-27 20:35:45 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-27 20:35:45 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT24920%27 HTTP/1.1" 200 None
2026-03-27 20:35:45 [auto1.be] INFO: Scrape type for GT24920: 0
2026-03-27 20:35:45 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK78813%27 HTTP/1.1" 200 None
2026-03-27 20:35:45 [auto1.be] INFO: Scrape type for CK78813: 0
2026-03-27 20:35:45 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL07479%27 HTTP/1.1" 200 None
2026-03-27 20:35:45 [auto1.be] INFO: Scrape type for FL07479: 2
2026-03-27 20:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d77253ca-6909-57d1-9654-bd83ba8cefc5 with identifier: FL07479
2026-03-27 20:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77253ca-6909-57d1-9654-bd83ba8cefc5 with scrape type 2
2026-03-27 20:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d77253ca-6909-57d1-9654-bd83ba8cefc5 with scrape type 2
2026-03-27 20:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d77253ca-6909-57d1-9654-bd83ba8cefc5, identifier: FL07479
2026-03-27 20:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d77253ca-6909-57d1-9654-bd83ba8cefc5 with identifier: FL07479
2026-03-27 20:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d77253ca-6909-57d1-9654-bd83ba8cefc5 with identifier: FL07479
2026-03-27 20:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d77253ca-6909-57d1-9654-bd83ba8cefc5 with identifier: FL07479 to the API
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:54:22Z',
 'fuel_type': 'petrol',
 'id': 'd77253ca-6909-57d1-9654-bd83ba8cefc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL07479',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 64182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-25',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL07479%27 HTTP/1.1" 200 None
2026-03-27 20:35:45 [auto1.be] INFO: Saving data for FL07479: {'auction_closing_time': 1774716862.0, 'created_time': 1773238443.544828, 'last_price_update_time': 1774643745.946668}
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL07479') HTTP/1.1" 204 0
2026-03-27 20:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-27 20:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24efa657-a08a-50ea-80cc-535f3b4eac61 with scrape type 1
2026-03-27 20:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24efa657-a08a-50ea-80cc-535f3b4eac61
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_194914e59030de330d8f6c3b381a34cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_194914e59030de330d8f6c3b381a34cc.jpg already downloaded
2026-03-27 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_5f2405c8d1a35218667a690b889db17c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_5f2405c8d1a35218667a690b889db17c.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_f26b62a4977dc76842edd0c7c7cf269e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_f26b62a4977dc76842edd0c7c7cf269e.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_8b0ae47ed55a65df7102c9f1bed57663.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_8b0ae47ed55a65df7102c9f1bed57663.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_167019a31b41a5bfb5548251fee84eb9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_167019a31b41a5bfb5548251fee84eb9.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_52a8fea8d20df1d03b4e53fe6c733e8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_52a8fea8d20df1d03b4e53fe6c733e8d.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_eb45fb8017aa12f96acf66df16224db0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_eb45fb8017aa12f96acf66df16224db0.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_144df71db008418b42bec3215d383d6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_144df71db008418b42bec3215d383d6e.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_2046a82c8808bfaeae6fe650c5843b74.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_2046a82c8808bfaeae6fe650c5843b74.jpg already downloaded
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F3c%252F913c5ab0c6d2941e016d49321801b6a0%252Fpa%252FTE72836_e53b81bed8545cd8a6a440126543a4ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_e53b81bed8545cd8a6a440126543a4ab.jpg already downloaded
2026-03-27 20:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24efa657-a08a-50ea-80cc-535f3b4eac61, identifier: TE72836
2026-03-27 20:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV70453%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for KV70453: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT18330%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for BT18330: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF01400%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for JF01400: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL13165%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for VL13165: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for WN85390: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV74957%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for KV74957: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for YB46987: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ37534%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for YJ37534: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for TY97185: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG04214%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for CG04214: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: UD60313
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD60313%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for UD60313: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH51844%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for BH51844: 0
2026-03-27 20:35:46 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ18869%27 HTTP/1.1" 200 None
2026-03-27 20:35:46 [auto1.be] INFO: Scrape type for DZ18869: 2
2026-03-27 20:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f with identifier: DZ18869
2026-03-27 20:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f with scrape type 2
2026-03-27 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f with scrape type 2
2026-03-27 20:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f, identifier: DZ18869
2026-03-27 20:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 20:35:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836
2026-03-27 20:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24efa657-a08a-50ea-80cc-535f3b4eac61 with identifier: TE72836 to the API
2026-03-27 20:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE72836>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:23Z',
 'fuel_type': 'diesel',
 'id': '24efa657-a08a-50ea-80cc-535f3b4eac61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE72836',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 126487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_194914e59030de330d8f6c3b381a34cc.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_5f2405c8d1a35218667a690b889db17c.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_f26b62a4977dc76842edd0c7c7cf269e.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_8b0ae47ed55a65df7102c9f1bed57663.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_167019a31b41a5bfb5548251fee84eb9.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_52a8fea8d20df1d03b4e53fe6c733e8d.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_eb45fb8017aa12f96acf66df16224db0.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_144df71db008418b42bec3215d383d6e.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_2046a82c8808bfaeae6fe650c5843b74.jpg',
                'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_e53b81bed8545cd8a6a440126543a4ab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_194914e59030de330d8f6c3b381a34cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_5f2405c8d1a35218667a690b889db17c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_f26b62a4977dc76842edd0c7c7cf269e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_8b0ae47ed55a65df7102c9f1bed57663.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_167019a31b41a5bfb5548251fee84eb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_52a8fea8d20df1d03b4e53fe6c733e8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_eb45fb8017aa12f96acf66df16224db0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656107,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_144df71db008418b42bec3215d383d6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_2046a82c8808bfaeae6fe650c5843b74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24efa657-a08a-50ea-80cc-535f3b4eac61/24efa657-a08a-50ea-80cc-535f3b4eac61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647345,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/3c/913c5ab0c6d2941e016d49321801b6a0/pa/TE72836_e53b81bed8545cd8a6a440126543a4ab.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-27 20:35:47 [auto1.be] INFO: Saving data for TE72836: {'created_time': 1774643747.114791, 'last_price_update_time': 1774643747.114811, 'auction_closing_time': 1774716023.0}
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TE72836') HTTP/1.1" 204 0
2026-03-27 20:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f with identifier: DZ18869
2026-03-27 20:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f with identifier: DZ18869
2026-03-27 20:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f with identifier: DZ18869 to the API
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-28T16:23:37Z',
 'fuel_type': 'hybrid',
 'id': 'cbc6821c-2bd3-5f5b-92dd-3f5fa732ee2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ18869',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 184175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-14',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ18869%27 HTTP/1.1" 200 None
2026-03-27 20:35:47 [auto1.be] INFO: Saving data for DZ18869: {'auction_closing_time': 1774715017.0, 'created_time': 1774557325.592898, 'last_price_update_time': 1774643747.490105}
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ18869') HTTP/1.1" 204 0
2026-03-27 20:35:47 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-27 20:36:06 [scrapy.extensions.logstats] INFO: Crawled 38 pages (at 38 pages/min), scraped 50 items (at 50 items/min)
2026-03-27 20:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-27 20:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:18 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:18 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-27 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC57264%27 HTTP/1.1" 200 None
2026-03-27 20:36:18 [auto1.be] INFO: Scrape type for PC57264: 0
2026-03-27 20:36:18 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-27 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-27 20:36:18 [auto1.be] INFO: Scrape type for ZF47475: 1
2026-03-27 20:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:18 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-27 20:36:18 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-27 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN83226%27 HTTP/1.1" 200 None
2026-03-27 20:36:18 [auto1.be] INFO: Scrape type for GN83226: 2
2026-03-27 20:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c6540c-a7d8-5ffa-929d-aa180c8d914e with identifier: GN83226
2026-03-27 20:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c6540c-a7d8-5ffa-929d-aa180c8d914e with scrape type 2
2026-03-27 20:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c6540c-a7d8-5ffa-929d-aa180c8d914e with scrape type 2
2026-03-27 20:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45c6540c-a7d8-5ffa-929d-aa180c8d914e, identifier: GN83226
2026-03-27 20:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45c6540c-a7d8-5ffa-929d-aa180c8d914e with identifier: GN83226
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-27 20:36:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45c6540c-a7d8-5ffa-929d-aa180c8d914e with identifier: GN83226
2026-03-27 20:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45c6540c-a7d8-5ffa-929d-aa180c8d914e with identifier: GN83226 to the API
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:00:08Z',
 'fuel_type': 'gas',
 'id': '45c6540c-a7d8-5ffa-929d-aa180c8d914e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN83226',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 20448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-12',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Journey',
 'transmission': 'manual',
 'trim': 'Journey',
 'year': 2023}
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN83226%27 HTTP/1.1" 200 None
2026-03-27 20:36:19 [auto1.be] INFO: Saving data for GN83226: {'auction_closing_time': 1774713608.0, 'created_time': 1773237962.595848, 'last_price_update_time': 1774643779.519295}
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN83226') HTTP/1.1" 204 0
2026-03-27 20:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:19 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD12029%27 HTTP/1.1" 200 None
2026-03-27 20:36:19 [auto1.be] INFO: Scrape type for RD12029: 2
2026-03-27 20:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f08596-1f24-5592-a820-2a619e57f946 with identifier: RD12029
2026-03-27 20:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f08596-1f24-5592-a820-2a619e57f946 with scrape type 2
2026-03-27 20:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94f08596-1f24-5592-a820-2a619e57f946 with scrape type 2
2026-03-27 20:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94f08596-1f24-5592-a820-2a619e57f946, identifier: RD12029
2026-03-27 20:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94f08596-1f24-5592-a820-2a619e57f946 with identifier: RD12029
2026-03-27 20:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94f08596-1f24-5592-a820-2a619e57f946 with identifier: RD12029
2026-03-27 20:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94f08596-1f24-5592-a820-2a619e57f946 with identifier: RD12029 to the API
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:05:28Z',
 'fuel_type': 'diesel',
 'id': '94f08596-1f24-5592-a820-2a619e57f946',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD12029',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 83730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-16',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD12029%27 HTTP/1.1" 200 None
2026-03-27 20:36:19 [auto1.be] INFO: Saving data for RD12029: {'auction_closing_time': 1774713928.0, 'created_time': 1773301736.751791, 'last_price_update_time': 1774643779.991455}
2026-03-27 20:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD12029') HTTP/1.1" 204 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ07927%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for RZ07927: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR81556%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for LR81556: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ84188%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for UJ84188: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for JR35998: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW50978%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for TW50978: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE86423%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for GE86423: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE10158%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for AE10158: 2
2026-03-27 20:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4c77fc8-0260-5d9d-b97b-c005fc9448e0 with identifier: AE10158
2026-03-27 20:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4c77fc8-0260-5d9d-b97b-c005fc9448e0 with scrape type 2
2026-03-27 20:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4c77fc8-0260-5d9d-b97b-c005fc9448e0 with scrape type 2
2026-03-27 20:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4c77fc8-0260-5d9d-b97b-c005fc9448e0, identifier: AE10158
2026-03-27 20:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4c77fc8-0260-5d9d-b97b-c005fc9448e0 with identifier: AE10158
2026-03-27 20:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4c77fc8-0260-5d9d-b97b-c005fc9448e0 with identifier: AE10158
2026-03-27 20:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4c77fc8-0260-5d9d-b97b-c005fc9448e0 with identifier: AE10158 to the API
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:30:33Z',
 'fuel_type': 'petrol',
 'id': 'f4c77fc8-0260-5d9d-b97b-c005fc9448e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE10158',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 281031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2017}
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE10158%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Saving data for AE10158: {'auction_closing_time': 1774715433.0, 'created_time': 1774438560.581447, 'last_price_update_time': 1774643780.7088}
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE10158') HTTP/1.1" 204 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW03008%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for PW03008: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ92015%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for DJ92015: 0
2026-03-27 20:36:20 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML32022%27 HTTP/1.1" 200 None
2026-03-27 20:36:20 [auto1.be] INFO: Scrape type for ML32022: 2
2026-03-27 20:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad277bdd-95a1-5953-b34f-0f86dcd60c5b with identifier: ML32022
2026-03-27 20:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad277bdd-95a1-5953-b34f-0f86dcd60c5b with scrape type 2
2026-03-27 20:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad277bdd-95a1-5953-b34f-0f86dcd60c5b with scrape type 2
2026-03-27 20:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad277bdd-95a1-5953-b34f-0f86dcd60c5b, identifier: ML32022
2026-03-27 20:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad277bdd-95a1-5953-b34f-0f86dcd60c5b with identifier: ML32022
2026-03-27 20:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad277bdd-95a1-5953-b34f-0f86dcd60c5b with identifier: ML32022
2026-03-27 20:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad277bdd-95a1-5953-b34f-0f86dcd60c5b with identifier: ML32022 to the API
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:37:50Z',
 'fuel_type': 'petrol',
 'id': 'ad277bdd-95a1-5953-b34f-0f86dcd60c5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML32022',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 121793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2020}
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML32022%27 HTTP/1.1" 200 None
2026-03-27 20:36:21 [auto1.be] INFO: Saving data for ML32022: {'auction_closing_time': 1774715870.0, 'created_time': 1774438622.989322, 'last_price_update_time': 1774643781.307804}
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML32022') HTTP/1.1" 204 0
2026-03-27 20:36:21 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM94904%27 HTTP/1.1" 200 None
2026-03-27 20:36:21 [auto1.be] INFO: Scrape type for RM94904: 0
2026-03-27 20:36:21 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC12895%27 HTTP/1.1" 200 None
2026-03-27 20:36:21 [auto1.be] INFO: Scrape type for YC12895: 0
2026-03-27 20:36:21 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF46667%27 HTTP/1.1" 200 None
2026-03-27 20:36:21 [auto1.be] INFO: Scrape type for DF46667: 2
2026-03-27 20:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0437fcf9-68b2-5c4d-ad8d-d41f5cda8880 with identifier: DF46667
2026-03-27 20:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0437fcf9-68b2-5c4d-ad8d-d41f5cda8880 with scrape type 2
2026-03-27 20:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0437fcf9-68b2-5c4d-ad8d-d41f5cda8880 with scrape type 2
2026-03-27 20:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0437fcf9-68b2-5c4d-ad8d-d41f5cda8880, identifier: DF46667
2026-03-27 20:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0437fcf9-68b2-5c4d-ad8d-d41f5cda8880 with identifier: DF46667
2026-03-27 20:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0437fcf9-68b2-5c4d-ad8d-d41f5cda8880 with identifier: DF46667
2026-03-27 20:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0437fcf9-68b2-5c4d-ad8d-d41f5cda8880 with identifier: DF46667 to the API
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:55:04Z',
 'fuel_type': 'diesel',
 'id': '0437fcf9-68b2-5c4d-ad8d-d41f5cda8880',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF46667',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 67212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-14',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Futura',
 'transmission': 'manual',
 'trim': 'Futura',
 'year': 2005}
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF46667%27 HTTP/1.1" 200 None
2026-03-27 20:36:21 [auto1.be] INFO: Saving data for DF46667: {'auction_closing_time': 1774716904.0, 'created_time': 1774438534.106252, 'last_price_update_time': 1774643781.714088}
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF46667') HTTP/1.1" 204 0
2026-03-27 20:36:21 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD21641%27 HTTP/1.1" 200 None
2026-03-27 20:36:21 [auto1.be] INFO: Scrape type for TD21641: 0
2026-03-27 20:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF47475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF47475> (referer: https://www.auto1.com/v1/car-details-view/ZF47475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-27 20:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf00e69-3619-56e2-a498-2a546291fd09 with scrape type 1
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_8f6d1d105faec197b40e5abc14489660.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_8f6d1d105faec197b40e5abc14489660.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_0fb6f6f874b93e011e1e35368cdc1958.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_0fb6f6f874b93e011e1e35368cdc1958.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_27ddc1ef27ef785267aededcabafcece.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_27ddc1ef27ef785267aededcabafcece.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_033ad40e343dcb8bd19cb5cbd6b947b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_033ad40e343dcb8bd19cb5cbd6b947b5.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_1c9a06b3eddc3f311c8db55719f5cda4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1c9a06b3eddc3f311c8db55719f5cda4.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_f88d6bdb3c67fd5e53ca1752584ac5f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_f88d6bdb3c67fd5e53ca1752584ac5f3.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_16d771c211a9f51a9937e65f01b16e63.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_16d771c211a9f51a9937e65f01b16e63.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_1d0de2c1da069dbaa20c2be9a09133ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1d0de2c1da069dbaa20c2be9a09133ef.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_354642b8f5f4b6c23b74b35c3ac0bafe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_354642b8f5f4b6c23b74b35c3ac0bafe.jpg not downloaded yet
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_1f3963530655c73616ba2f053684c846.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1f3963530655c73616ba2f053684c846.jpg not downloaded yet
2026-03-27 20:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_8f6d1d105faec197b40e5abc14489660.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_0fb6f6f874b93e011e1e35368cdc1958.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_27ddc1ef27ef785267aededcabafcece.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1f3963530655c73616ba2f053684c846.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_16d771c211a9f51a9937e65f01b16e63.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dc4290>
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_8f6d1d105faec197b40e5abc14489660.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_8f6d1d105faec197b40e5abc14489660.jpg saved to cache
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_033ad40e343dcb8bd19cb5cbd6b947b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_354642b8f5f4b6c23b74b35c3ac0bafe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e75ad0>
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_0fb6f6f874b93e011e1e35368cdc1958.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_0fb6f6f874b93e011e1e35368cdc1958.jpg saved to cache
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ecc990>
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_27ddc1ef27ef785267aededcabafcece.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_27ddc1ef27ef785267aededcabafcece.jpg saved to cache
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eeabd0>
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_1f3963530655c73616ba2f053684c846.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1f3963530655c73616ba2f053684c846.jpg saved to cache
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9e050>
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_16d771c211a9f51a9937e65f01b16e63.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_16d771c211a9f51a9937e65f01b16e63.jpg saved to cache
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1c9a06b3eddc3f311c8db55719f5cda4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1d0de2c1da069dbaa20c2be9a09133ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_f88d6bdb3c67fd5e53ca1752584ac5f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e5aa10>
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_033ad40e343dcb8bd19cb5cbd6b947b5.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_033ad40e343dcb8bd19cb5cbd6b947b5.jpg saved to cache
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d9b910>
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_354642b8f5f4b6c23b74b35c3ac0bafe.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_354642b8f5f4b6c23b74b35c3ac0bafe.jpg saved to cache
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:24 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:24 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-27 20:36:24 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW94232%27 HTTP/1.1" 200 None
2026-03-27 20:36:24 [auto1.be] INFO: Scrape type for GW94232: 2
2026-03-27 20:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ef665b-4f5c-5fd7-b90a-bc96e45e195a with identifier: GW94232
2026-03-27 20:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ef665b-4f5c-5fd7-b90a-bc96e45e195a with scrape type 2
2026-03-27 20:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81ef665b-4f5c-5fd7-b90a-bc96e45e195a with scrape type 2
2026-03-27 20:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 81ef665b-4f5c-5fd7-b90a-bc96e45e195a, identifier: GW94232
2026-03-27 20:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 81ef665b-4f5c-5fd7-b90a-bc96e45e195a with identifier: GW94232
2026-03-27 20:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 81ef665b-4f5c-5fd7-b90a-bc96e45e195a with identifier: GW94232
2026-03-27 20:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 81ef665b-4f5c-5fd7-b90a-bc96e45e195a with identifier: GW94232 to the API
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:55Z',
 'fuel_type': 'diesel',
 'id': '81ef665b-4f5c-5fd7-b90a-bc96e45e195a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW94232',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 144869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-24',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2018}
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW94232%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Saving data for GW94232: {'auction_closing_time': 1774714915.0, 'created_time': 1774438610.445788, 'last_price_update_time': 1774643785.038521}
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW94232') HTTP/1.1" 204 0
2026-03-27 20:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB55394%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for LB55394: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for AX27110: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB85934%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for GB85934: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR37992%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for PR37992: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for MD92482: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL89741%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for HL89741: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER13199%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for ER13199: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM74317%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for FM74317: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR10172%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for WR10172: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN70818%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for YN70818: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ60295%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for DZ60295: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-27 20:36:25 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL95058%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Scrape type for YL95058: 2
2026-03-27 20:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77716122-c069-5d3d-a3e2-43505ed6933b with identifier: YL95058
2026-03-27 20:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77716122-c069-5d3d-a3e2-43505ed6933b with scrape type 2
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77716122-c069-5d3d-a3e2-43505ed6933b with scrape type 2
2026-03-27 20:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77716122-c069-5d3d-a3e2-43505ed6933b, identifier: YL95058
2026-03-27 20:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77716122-c069-5d3d-a3e2-43505ed6933b with identifier: YL95058
2026-03-27 20:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77716122-c069-5d3d-a3e2-43505ed6933b with identifier: YL95058
2026-03-27 20:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77716122-c069-5d3d-a3e2-43505ed6933b with identifier: YL95058 to the API
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:59:07Z',
 'fuel_type': 'petrol',
 'id': '77716122-c069-5d3d-a3e2-43505ed6933b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL95058',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 192946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 VTi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2015}
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL95058%27 HTTP/1.1" 200 None
2026-03-27 20:36:25 [auto1.be] INFO: Saving data for YL95058: {'auction_closing_time': 1774717147.0, 'created_time': 1774438532.772829, 'last_price_update_time': 1774643785.74899}
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL95058') HTTP/1.1" 204 0
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9fd50>
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_1c9a06b3eddc3f311c8db55719f5cda4.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1c9a06b3eddc3f311c8db55719f5cda4.jpg saved to cache
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903da1450>
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_1d0de2c1da069dbaa20c2be9a09133ef.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1d0de2c1da069dbaa20c2be9a09133ef.jpg saved to cache
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6ce90>
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F1e%252Ff91eb70aea6b3717cdfbd0ed318d4570%252Fpa%252FZF47475_f88d6bdb3c67fd5e53ca1752584ac5f3.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_f88d6bdb3c67fd5e53ca1752584ac5f3.jpg saved to cache
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebf00e69-3619-56e2-a498-2a546291fd09
2026-03-27 20:36:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebf00e69-3619-56e2-a498-2a546291fd09, skipping ID generation
2026-03-27 20:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf00e69-3619-56e2-a498-2a546291fd09 with scrape type 1
2026-03-27 20:36:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebf00e69-3619-56e2-a498-2a546291fd09 sending to next pipeline
2026-03-27 20:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebf00e69-3619-56e2-a498-2a546291fd09, identifier: ZF47475
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Scrape type for GW87029: 0
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY14138%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Scrape type for BY14138: 0
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF17884%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Scrape type for EF17884: 0
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-27 20:36:26 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN66713%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Scrape type for CN66713: 2
2026-03-27 20:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520aa18e-7fe2-5077-b090-1f32a41a807d with identifier: CN66713
2026-03-27 20:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520aa18e-7fe2-5077-b090-1f32a41a807d with scrape type 2
2026-03-27 20:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 520aa18e-7fe2-5077-b090-1f32a41a807d with scrape type 2
2026-03-27 20:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 520aa18e-7fe2-5077-b090-1f32a41a807d, identifier: CN66713
2026-03-27 20:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-27 20:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475
2026-03-27 20:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebf00e69-3619-56e2-a498-2a546291fd09 with identifier: ZF47475 to the API
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_f88d6bdb3c67fd5e53ca1752584ac5f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:44:22Z',
 'fuel_type': 'diesel',
 'id': 'ebf00e69-3619-56e2-a498-2a546291fd09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF47475',
 'listing': 'auction',
 'location': 'BE, Grimbergen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 181427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_8f6d1d105faec197b40e5abc14489660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_0fb6f6f874b93e011e1e35368cdc1958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_27ddc1ef27ef785267aededcabafcece.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_033ad40e343dcb8bd19cb5cbd6b947b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1c9a06b3eddc3f311c8db55719f5cda4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_f88d6bdb3c67fd5e53ca1752584ac5f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_16d771c211a9f51a9937e65f01b16e63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1d0de2c1da069dbaa20c2be9a09133ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_354642b8f5f4b6c23b74b35c3ac0bafe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf00e69-3619-56e2-a498-2a546291fd09/ebf00e69-3619-56e2-a498-2a546291fd09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/1e/f91eb70aea6b3717cdfbd0ed318d4570/pa/ZF47475_1f3963530655c73616ba2f053684c846.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Saving data for ZF47475: {'created_time': 1774643786.561997, 'last_price_update_time': 1774643786.562007, 'auction_closing_time': 1774716262.0}
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF47475') HTTP/1.1" 204 0
2026-03-27 20:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 520aa18e-7fe2-5077-b090-1f32a41a807d with identifier: CN66713
2026-03-27 20:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 520aa18e-7fe2-5077-b090-1f32a41a807d with identifier: CN66713
2026-03-27 20:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 520aa18e-7fe2-5077-b090-1f32a41a807d with identifier: CN66713 to the API
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:55:03Z',
 'fuel_type': 'diesel',
 'id': '520aa18e-7fe2-5077-b090-1f32a41a807d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN66713',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 20988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-28',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN66713%27 HTTP/1.1" 200 None
2026-03-27 20:36:26 [auto1.be] INFO: Saving data for CN66713: {'auction_closing_time': 1774716903.0, 'created_time': 1774438565.306906, 'last_price_update_time': 1774643786.84679}
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN66713') HTTP/1.1" 204 0
2026-03-27 20:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:27 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ63633%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for EJ63633: 0
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV18687%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for CV18687: 0
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-27 20:36:27 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-27 20:36:27 [auto1.be] INFO: Scrape type for NA97131: 2
2026-03-27 20:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131
2026-03-27 20:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa512bfd-815a-5736-a788-9086ccd09518 with scrape type 2
2026-03-27 20:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa512bfd-815a-5736-a788-9086ccd09518 with scrape type 2
2026-03-27 20:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa512bfd-815a-5736-a788-9086ccd09518, identifier: NA97131
2026-03-27 20:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131
2026-03-27 20:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131
2026-03-27 20:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131 to the API
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:26Z',
 'fuel_type': 'diesel',
 'id': 'fa512bfd-815a-5736-a788-9086ccd09518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA97131',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 240009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-27 20:36:28 [auto1.be] INFO: Saving data for NA97131: {'auction_closing_time': 1774714706.0, 'created_time': 1773693880.422455, 'last_price_update_time': 1774643788.323719}
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NA97131') HTTP/1.1" 204 0
2026-03-27 20:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-27 20:36:28 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-27 20:36:28 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-27 20:36:28 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-27 20:36:28 [auto1.be] INFO: Scrape type for VJ27978: 2
2026-03-27 20:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-27 20:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff84086-90db-5d0d-8aaa-41cb224de801 with scrape type 2
2026-03-27 20:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff84086-90db-5d0d-8aaa-41cb224de801 with scrape type 2
2026-03-27 20:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ff84086-90db-5d0d-8aaa-41cb224de801, identifier: VJ27978
2026-03-27 20:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-27 20:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978
2026-03-27 20:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ff84086-90db-5d0d-8aaa-41cb224de801 with identifier: VJ27978 to the API
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:13:47Z',
 'fuel_type': 'petrol',
 'id': '1ff84086-90db-5d0d-8aaa-41cb224de801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ27978',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 76327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2022}
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-27 20:36:28 [auto1.be] INFO: Saving data for VJ27978: {'auction_closing_time': 1774714427.0, 'created_time': 1774557326.931693, 'last_price_update_time': 1774643788.837659}
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VJ27978') HTTP/1.1" 204 0
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-27 20:36:28 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-27 20:36:28 [auto1.be] INFO: Scrape type for AM99393: 2
2026-03-27 20:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393
2026-03-27 20:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with scrape type 2
2026-03-27 20:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with scrape type 2
2026-03-27 20:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3, identifier: AM99393
2026-03-27 20:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393
2026-03-27 20:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393
2026-03-27 20:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393 to the API
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:06:59Z',
 'fuel_type': 'petrol',
 'id': 'c90fb8a8-91a1-54dd-8974-52c2bc22dbf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM99393',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 150170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-03',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2013}
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-27 20:36:29 [auto1.be] INFO: Saving data for AM99393: {'auction_closing_time': 1774714019.0, 'created_time': 1773384664.798402, 'last_price_update_time': 1774643789.216833}
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM99393') HTTP/1.1" 204 0
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY49769%27 HTTP/1.1" 200 None
2026-03-27 20:36:29 [auto1.be] INFO: Scrape type for XY49769: 2
2026-03-27 20:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 377212e6-3faa-5a77-9676-04d1ec9974e8 with identifier: XY49769
2026-03-27 20:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 377212e6-3faa-5a77-9676-04d1ec9974e8 with scrape type 2
2026-03-27 20:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 377212e6-3faa-5a77-9676-04d1ec9974e8 with scrape type 2
2026-03-27 20:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 377212e6-3faa-5a77-9676-04d1ec9974e8, identifier: XY49769
2026-03-27 20:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 377212e6-3faa-5a77-9676-04d1ec9974e8 with identifier: XY49769
2026-03-27 20:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 377212e6-3faa-5a77-9676-04d1ec9974e8 with identifier: XY49769
2026-03-27 20:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 377212e6-3faa-5a77-9676-04d1ec9974e8 with identifier: XY49769 to the API
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:57:11Z',
 'fuel_type': 'diesel',
 'id': '377212e6-3faa-5a77-9676-04d1ec9974e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY49769',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 20024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-12',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY49769%27 HTTP/1.1" 200 None
2026-03-27 20:36:29 [auto1.be] INFO: Saving data for XY49769: {'auction_closing_time': 1774717031.0, 'created_time': 1774438537.032013, 'last_price_update_time': 1774643789.6746}
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XY49769') HTTP/1.1" 204 0
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX92013%27 HTTP/1.1" 200 None
2026-03-27 20:36:29 [auto1.be] INFO: Scrape type for CX92013: 0
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-27 20:36:29 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-27 20:36:29 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-27 20:36:29 [auto1.be] INFO: Scrape type for LG02466: 2
2026-03-27 20:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-27 20:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79734c8b-9629-5726-8cb7-c47685c96b21 with scrape type 2
2026-03-27 20:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79734c8b-9629-5726-8cb7-c47685c96b21 with scrape type 2
2026-03-27 20:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79734c8b-9629-5726-8cb7-c47685c96b21, identifier: LG02466
2026-03-27 20:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-27 20:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-27 20:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466 to the API
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:11Z',
 'fuel_type': 'diesel',
 'id': '79734c8b-9629-5726-8cb7-c47685c96b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG02466',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 237146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2018}
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Saving data for LG02466: {'auction_closing_time': 1774713851.0, 'created_time': 1773239710.677546, 'last_price_update_time': 1774643790.085771}
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG02466') HTTP/1.1" 204 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB34897%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for YB34897: 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB62754%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for CB62754: 2
2026-03-27 20:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b71c2d75-c80a-536a-aaf6-6982e4fd421a with identifier: CB62754
2026-03-27 20:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b71c2d75-c80a-536a-aaf6-6982e4fd421a with scrape type 2
2026-03-27 20:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b71c2d75-c80a-536a-aaf6-6982e4fd421a with scrape type 2
2026-03-27 20:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b71c2d75-c80a-536a-aaf6-6982e4fd421a, identifier: CB62754
2026-03-27 20:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b71c2d75-c80a-536a-aaf6-6982e4fd421a with identifier: CB62754
2026-03-27 20:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b71c2d75-c80a-536a-aaf6-6982e4fd421a with identifier: CB62754
2026-03-27 20:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b71c2d75-c80a-536a-aaf6-6982e4fd421a with identifier: CB62754 to the API
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:54:54Z',
 'fuel_type': 'diesel',
 'id': 'b71c2d75-c80a-536a-aaf6-6982e4fd421a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB62754',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 308159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-12',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB62754%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Saving data for CB62754: {'auction_closing_time': 1774716894.0, 'created_time': 1773136493.418761, 'last_price_update_time': 1774643790.483451}
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB62754') HTTP/1.1" 204 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for MT09894: 1
2026-03-27 20:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:30 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE03465%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for KE03465: 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84534%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for BR84534: 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW31488%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for ZW31488: 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE01185%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for JE01185: 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-27 20:36:30 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE95179%27 HTTP/1.1" 200 None
2026-03-27 20:36:30 [auto1.be] INFO: Scrape type for CE95179: 2
2026-03-27 20:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77e5e1e4-7e96-5190-9a85-fd4a902ba1c0 with identifier: CE95179
2026-03-27 20:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77e5e1e4-7e96-5190-9a85-fd4a902ba1c0 with scrape type 2
2026-03-27 20:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77e5e1e4-7e96-5190-9a85-fd4a902ba1c0 with scrape type 2
2026-03-27 20:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77e5e1e4-7e96-5190-9a85-fd4a902ba1c0, identifier: CE95179
2026-03-27 20:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77e5e1e4-7e96-5190-9a85-fd4a902ba1c0 with identifier: CE95179
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 20:36:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77e5e1e4-7e96-5190-9a85-fd4a902ba1c0 with identifier: CE95179
2026-03-27 20:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77e5e1e4-7e96-5190-9a85-fd4a902ba1c0 with identifier: CE95179 to the API
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:16:01Z',
 'fuel_type': 'petrol',
 'id': '77e5e1e4-7e96-5190-9a85-fd4a902ba1c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE95179',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 153412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2016}
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE95179%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Saving data for CE95179: {'auction_closing_time': 1774714561.0, 'created_time': 1773135958.623265, 'last_price_update_time': 1774643791.74594}
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE95179') HTTP/1.1" 204 0
2026-03-27 20:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT01513%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Scrape type for JT01513: 0
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-27 20:36:31 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-27 20:36:31 [auto1.be] INFO: Scrape type for CP45384: 2
2026-03-27 20:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384
2026-03-27 20:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeeb539e-b277-507f-b39c-643e85304586 with scrape type 2
2026-03-27 20:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeeb539e-b277-507f-b39c-643e85304586 with scrape type 2
2026-03-27 20:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aeeb539e-b277-507f-b39c-643e85304586, identifier: CP45384
2026-03-27 20:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384
2026-03-27 20:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384
2026-03-27 20:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384 to the API
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:37:45Z',
 'fuel_type': 'diesel',
 'id': 'aeeb539e-b277-507f-b39c-643e85304586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP45384',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 120912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-13',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-27 20:36:32 [auto1.be] INFO: Saving data for CP45384: {'auction_closing_time': 1774715865.0, 'created_time': 1773132746.852, 'last_price_update_time': 1774643792.54801}
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP45384') HTTP/1.1" 204 0
2026-03-27 20:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT09894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-27 20:36:32 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-27 20:36:32 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW00167%27 HTTP/1.1" 200 None
2026-03-27 20:36:32 [auto1.be] INFO: Scrape type for CW00167: 0
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-27 20:36:32 [auto1.be] INFO: Scrape type for BH52169: 0
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-27 20:36:32 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-27 20:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:33 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:33 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP41015%27 HTTP/1.1" 200 None
2026-03-27 20:36:33 [auto1.be] INFO: Scrape type for NP41015: 0
2026-03-27 20:36:33 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG88652%27 HTTP/1.1" 200 None
2026-03-27 20:36:33 [auto1.be] INFO: Scrape type for NG88652: 2
2026-03-27 20:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eedee7d5-70ef-54bb-8c16-043198c7cb78 with identifier: NG88652
2026-03-27 20:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eedee7d5-70ef-54bb-8c16-043198c7cb78 with scrape type 2
2026-03-27 20:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eedee7d5-70ef-54bb-8c16-043198c7cb78 with scrape type 2
2026-03-27 20:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eedee7d5-70ef-54bb-8c16-043198c7cb78, identifier: NG88652
2026-03-27 20:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eedee7d5-70ef-54bb-8c16-043198c7cb78 with identifier: NG88652
2026-03-27 20:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eedee7d5-70ef-54bb-8c16-043198c7cb78 with identifier: NG88652
2026-03-27 20:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eedee7d5-70ef-54bb-8c16-043198c7cb78 with identifier: NG88652 to the API
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:24Z',
 'fuel_type': 'diesel',
 'id': 'eedee7d5-70ef-54bb-8c16-043198c7cb78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG88652',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 148115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-06',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG88652%27 HTTP/1.1" 200 None
2026-03-27 20:36:33 [auto1.be] INFO: Saving data for NG88652: {'auction_closing_time': 1774714764.0, 'created_time': 1774438544.635859, 'last_price_update_time': 1774643793.997176}
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG88652') HTTP/1.1" 204 0
2026-03-27 20:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for TX28125: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ92859%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for SJ92859: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB55358%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for RB55358: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL08078%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for SL08078: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49722%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for TE49722: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU36315%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for PU36315: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN37079%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for NN37079: 2
2026-03-27 20:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19767893-04cb-514b-8198-b6f5b79796d4 with identifier: NN37079
2026-03-27 20:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19767893-04cb-514b-8198-b6f5b79796d4 with scrape type 2
2026-03-27 20:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19767893-04cb-514b-8198-b6f5b79796d4 with scrape type 2
2026-03-27 20:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19767893-04cb-514b-8198-b6f5b79796d4, identifier: NN37079
2026-03-27 20:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19767893-04cb-514b-8198-b6f5b79796d4 with identifier: NN37079
2026-03-27 20:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19767893-04cb-514b-8198-b6f5b79796d4 with identifier: NN37079
2026-03-27 20:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19767893-04cb-514b-8198-b6f5b79796d4 with identifier: NN37079 to the API
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:16:01Z',
 'fuel_type': 'diesel',
 'id': '19767893-04cb-514b-8198-b6f5b79796d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN37079',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'X-Klasse',
 'odometer': 155656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Mercedes-Benz X-Klasse X 350 d 4Matic Doppelkabine Power',
 'transmission': 'automatic',
 'trim': '4Matic Doppelkabine Power',
 'year': 2019}
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN37079%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Saving data for NN37079: {'auction_closing_time': 1774714561.0, 'created_time': 1774438592.135805, 'last_price_update_time': 1774643794.619655}
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN37079') HTTP/1.1" 204 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for SZ91004: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ44217%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for WZ44217: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR75863%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for NR75863: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for VZ08217: 1
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-27 20:36:34 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-27 20:36:34 [auto1.be] INFO: Scrape type for LK55982: 2
2026-03-27 20:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-27 20:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184efd05-1fb9-5849-b280-511811641ad9 with scrape type 2
2026-03-27 20:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184efd05-1fb9-5849-b280-511811641ad9 with scrape type 2
2026-03-27 20:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 184efd05-1fb9-5849-b280-511811641ad9, identifier: LK55982
2026-03-27 20:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-27 20:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982
2026-03-27 20:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 184efd05-1fb9-5849-b280-511811641ad9 with identifier: LK55982 to the API
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:47:53Z',
 'fuel_type': 'diesel',
 'id': '184efd05-1fb9-5849-b280-511811641ad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK55982',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 138400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-05',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 30 L1H1 Business',
 'transmission': 'manual',
 'trim': '30 L1H1 Business',
 'year': 2018}
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [auto1.be] INFO: Saving data for LK55982: {'auction_closing_time': 1774716473.0, 'created_time': 1774557326.626571, 'last_price_update_time': 1774643795.205977}
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK55982') HTTP/1.1" 204 0
2026-03-27 20:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:35 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-27 20:36:35 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP19111%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [auto1.be] INFO: Scrape type for SP19111: 0
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT09894> (referer: https://www.auto1.com/v1/car-details-view/MT09894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-27 20:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with scrape type 1
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_f1588cf039b539c7541a20943191f286.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_f1588cf039b539c7541a20943191f286.jpg not downloaded yet
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_42294a595e3ecc67fea42c3f1548b739.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_42294a595e3ecc67fea42c3f1548b739.jpg not downloaded yet
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_80db2296c4b9d90df39a54349b4b5b1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_80db2296c4b9d90df39a54349b4b5b1c.jpg not downloaded yet
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_96d8aa7a9833dc159acc8003c6aab559.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_96d8aa7a9833dc159acc8003c6aab559.jpg not downloaded yet
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_a4c21da595b6a834054eab4fa61951d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_a4c21da595b6a834054eab4fa61951d8.jpg not downloaded yet
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_36630bf1bb4dbacb5b6fb5105eb289b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_36630bf1bb4dbacb5b6fb5105eb289b4.jpg not downloaded yet
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_96d8aa7a9833dc159acc8003c6aab559.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_edb734fff9f4cedb2b4ceadc3d61a7d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_edb734fff9f4cedb2b4ceadc3d61a7d0.jpg not downloaded yet
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_f1588cf039b539c7541a20943191f286.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_80db2296c4b9d90df39a54349b4b5b1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_d3a3e8811eefc37fa773bc58ee08d3c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_d3a3e8811eefc37fa773bc58ee08d3c0.jpg not downloaded yet
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_da731f3eab27f0f96a5e623796561b37.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_da731f3eab27f0f96a5e623796561b37.jpg not downloaded yet
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_3460c74a4723472dc0aca8f074138887.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_3460c74a4723472dc0aca8f074138887.jpg not downloaded yet
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fcf090>
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_96d8aa7a9833dc159acc8003c6aab559.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_96d8aa7a9833dc159acc8003c6aab559.jpg saved to cache
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_42294a595e3ecc67fea42c3f1548b739.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912110d50>
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_f1588cf039b539c7541a20943191f286.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_f1588cf039b539c7541a20943191f286.jpg saved to cache
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e3d2d0>
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_80db2296c4b9d90df39a54349b4b5b1c.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_80db2296c4b9d90df39a54349b4b5b1c.jpg saved to cache
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_edb734fff9f4cedb2b4ceadc3d61a7d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d83e50>
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_42294a595e3ecc67fea42c3f1548b739.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_42294a595e3ecc67fea42c3f1548b739.jpg saved to cache
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_36630bf1bb4dbacb5b6fb5105eb289b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_a4c21da595b6a834054eab4fa61951d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_d3a3e8811eefc37fa773bc58ee08d3c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_da731f3eab27f0f96a5e623796561b37.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_3460c74a4723472dc0aca8f074138887.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d0aad0>
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_edb734fff9f4cedb2b4ceadc3d61a7d0.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_edb734fff9f4cedb2b4ceadc3d61a7d0.jpg saved to cache
2026-03-27 20:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dbba50>
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_36630bf1bb4dbacb5b6fb5105eb289b4.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_36630bf1bb4dbacb5b6fb5105eb289b4.jpg saved to cache
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dba9d0>
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_a4c21da595b6a834054eab4fa61951d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_a4c21da595b6a834054eab4fa61951d8.jpg saved to cache
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911e45010>
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_d3a3e8811eefc37fa773bc58ee08d3c0.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_d3a3e8811eefc37fa773bc58ee08d3c0.jpg saved to cache
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e4b0d0>
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_da731f3eab27f0f96a5e623796561b37.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_da731f3eab27f0f96a5e623796561b37.jpg saved to cache
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d78e90>
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc9%252F33c937db79634ef7554d4ebb0bde548f%252Fpa%252FMT09894_3460c74a4723472dc0aca8f074138887.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_3460c74a4723472dc0aca8f074138887.jpg saved to cache
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750
2026-03-27 20:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09e36a63-89b1-5ad1-a527-9d17f6ca5750, skipping ID generation
2026-03-27 20:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with scrape type 1
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09e36a63-89b1-5ad1-a527-9d17f6ca5750 sending to next pipeline
2026-03-27 20:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09e36a63-89b1-5ad1-a527-9d17f6ca5750, identifier: MT09894
2026-03-27 20:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-27 20:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894
2026-03-27 20:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09e36a63-89b1-5ad1-a527-9d17f6ca5750 with identifier: MT09894 to the API
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_3460c74a4723472dc0aca8f074138887.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:55Z',
 'fuel_type': 'petrol',
 'id': '09e36a63-89b1-5ad1-a527-9d17f6ca5750',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT09894',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 71076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_f1588cf039b539c7541a20943191f286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_42294a595e3ecc67fea42c3f1548b739.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_80db2296c4b9d90df39a54349b4b5b1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_96d8aa7a9833dc159acc8003c6aab559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_a4c21da595b6a834054eab4fa61951d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_36630bf1bb4dbacb5b6fb5105eb289b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_edb734fff9f4cedb2b4ceadc3d61a7d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_d3a3e8811eefc37fa773bc58ee08d3c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_da731f3eab27f0f96a5e623796561b37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e36a63-89b1-5ad1-a527-9d17f6ca5750/09e36a63-89b1-5ad1-a527-9d17f6ca5750_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c9/33c937db79634ef7554d4ebb0bde548f/pa/MT09894_3460c74a4723472dc0aca8f074138887.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 Turbo Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2016}
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-27 20:36:36 [auto1.be] INFO: Saving data for MT09894: {'created_time': 1774643796.670155, 'last_price_update_time': 1774643796.670165, 'auction_closing_time': 1774715095.0}
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MT09894') HTTP/1.1" 204 0
2026-03-27 20:36:36 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ08217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:36 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-27 20:36:36 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF62281%27 HTTP/1.1" 200 None
2026-03-27 20:36:36 [auto1.be] INFO: Scrape type for BF62281: 2
2026-03-27 20:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7a5d03-e635-5101-8843-f7f6c5abb20c with identifier: BF62281
2026-03-27 20:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7a5d03-e635-5101-8843-f7f6c5abb20c with scrape type 2
2026-03-27 20:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e7a5d03-e635-5101-8843-f7f6c5abb20c with scrape type 2
2026-03-27 20:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e7a5d03-e635-5101-8843-f7f6c5abb20c, identifier: BF62281
2026-03-27 20:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e7a5d03-e635-5101-8843-f7f6c5abb20c with identifier: BF62281
2026-03-27 20:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e7a5d03-e635-5101-8843-f7f6c5abb20c with identifier: BF62281
2026-03-27 20:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e7a5d03-e635-5101-8843-f7f6c5abb20c with identifier: BF62281 to the API
2026-03-27 20:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:46:42Z',
 'fuel_type': 'diesel',
 'id': '6e7a5d03-e635-5101-8843-f7f6c5abb20c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF62281',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 287179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-24',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.7 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF62281%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Saving data for BF62281: {'auction_closing_time': 1774716402.0, 'created_time': 1774438565.872524, 'last_price_update_time': 1774643797.126349}
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BF62281') HTTP/1.1" 204 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM06752%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for KM06752: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ21578%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for KZ21578: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for XT14784: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ29729%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for PJ29729: 2
2026-03-27 20:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca54be9-760f-5aa8-8516-4001acc18636 with identifier: PJ29729
2026-03-27 20:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca54be9-760f-5aa8-8516-4001acc18636 with scrape type 2
2026-03-27 20:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ca54be9-760f-5aa8-8516-4001acc18636 with scrape type 2
2026-03-27 20:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ca54be9-760f-5aa8-8516-4001acc18636, identifier: PJ29729
2026-03-27 20:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ca54be9-760f-5aa8-8516-4001acc18636 with identifier: PJ29729
2026-03-27 20:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ca54be9-760f-5aa8-8516-4001acc18636 with identifier: PJ29729
2026-03-27 20:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ca54be9-760f-5aa8-8516-4001acc18636 with identifier: PJ29729 to the API
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:43Z',
 'fuel_type': 'diesel',
 'id': '5ca54be9-760f-5aa8-8516-4001acc18636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ29729',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 237674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-17',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ29729%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Saving data for PJ29729: {'auction_closing_time': 1774715863.0, 'created_time': 1774438540.158543, 'last_price_update_time': 1774643797.628688}
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ29729') HTTP/1.1" 204 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY27857%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for ZY27857: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX65189%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for NX65189: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN30379%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for WN30379: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for AX26323: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for DZ54195: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA45415%27 HTTP/1.1" 200 None
2026-03-27 20:36:37 [auto1.be] INFO: Scrape type for FA45415: 0
2026-03-27 20:36:37 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS89988%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for DS89988: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY85639%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for HY85639: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP50395%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for RP50395: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM97787%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for XM97787: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR57009%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for TR57009: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV70837%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for FV70837: 0
2026-03-27 20:36:38 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB39644%27 HTTP/1.1" 200 None
2026-03-27 20:36:38 [auto1.be] INFO: Scrape type for TB39644: 0
2026-03-27 20:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:39 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN95173%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for KN95173: 2
2026-03-27 20:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 052635c7-5391-5b2e-86ef-867a13005a86 with identifier: KN95173
2026-03-27 20:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 052635c7-5391-5b2e-86ef-867a13005a86 with scrape type 2
2026-03-27 20:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 052635c7-5391-5b2e-86ef-867a13005a86 with scrape type 2
2026-03-27 20:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 052635c7-5391-5b2e-86ef-867a13005a86, identifier: KN95173
2026-03-27 20:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 052635c7-5391-5b2e-86ef-867a13005a86 with identifier: KN95173
2026-03-27 20:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 052635c7-5391-5b2e-86ef-867a13005a86 with identifier: KN95173
2026-03-27 20:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 052635c7-5391-5b2e-86ef-867a13005a86 with identifier: KN95173 to the API
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:21:25Z',
 'fuel_type': 'diesel',
 'id': '052635c7-5391-5b2e-86ef-867a13005a86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN95173',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 43110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-23',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 e-HDi Intensive',
 'transmission': 'manual',
 'trim': 'Intensive',
 'year': 2014}
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN95173%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Saving data for KN95173: {'auction_closing_time': 1774714885.0, 'created_time': 1774438525.165508, 'last_price_update_time': 1774643799.475402}
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KN95173') HTTP/1.1" 204 0
2026-03-27 20:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU34385%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for TU34385: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB21597%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for RB21597: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC36147%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for DC36147: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV03405%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for TV03405: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT93863%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for PT93863: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT96766%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for UT96766: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF63760%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for NF63760: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB89666%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for HB89666: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32342%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for HU32342: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-27 20:36:39 [auto1.be] INFO: Scrape type for DZ24480: 0
2026-03-27 20:36:39 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-27 20:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:42 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD48468%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for JD48468: 0
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR78742%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for JR78742: 0
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE77274%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for VE77274: 2
2026-03-27 20:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 126a0d85-e793-5d78-9ba3-422944ea42e3 with identifier: VE77274
2026-03-27 20:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126a0d85-e793-5d78-9ba3-422944ea42e3 with scrape type 2
2026-03-27 20:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 126a0d85-e793-5d78-9ba3-422944ea42e3 with scrape type 2
2026-03-27 20:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 126a0d85-e793-5d78-9ba3-422944ea42e3, identifier: VE77274
2026-03-27 20:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 126a0d85-e793-5d78-9ba3-422944ea42e3 with identifier: VE77274
2026-03-27 20:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 126a0d85-e793-5d78-9ba3-422944ea42e3 with identifier: VE77274
2026-03-27 20:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 126a0d85-e793-5d78-9ba3-422944ea42e3 with identifier: VE77274 to the API
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:11:46Z',
 'fuel_type': 'diesel',
 'id': '126a0d85-e793-5d78-9ba3-422944ea42e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE77274',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 290561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-23',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2014}
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE77274%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Saving data for VE77274: {'auction_closing_time': 1774714306.0, 'created_time': 1773135911.976809, 'last_price_update_time': 1774643802.518286}
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE77274') HTTP/1.1" 204 0
2026-03-27 20:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:42 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Scrape type for WB76864: 2
2026-03-27 20:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-27 20:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 825dd81e-9076-5079-9d23-98c279b4786f with scrape type 2
2026-03-27 20:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 825dd81e-9076-5079-9d23-98c279b4786f with scrape type 2
2026-03-27 20:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 825dd81e-9076-5079-9d23-98c279b4786f, identifier: WB76864
2026-03-27 20:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-27 20:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864
2026-03-27 20:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 825dd81e-9076-5079-9d23-98c279b4786f with identifier: WB76864 to the API
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:45Z',
 'fuel_type': 'diesel',
 'id': '825dd81e-9076-5079-9d23-98c279b4786f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB76864',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 109364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2017}
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-27 20:36:42 [auto1.be] INFO: Saving data for WB76864: {'auction_closing_time': 1774715085.0, 'created_time': 1774557353.277715, 'last_price_update_time': 1774643802.951586}
2026-03-27 20:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WB76864') HTTP/1.1" 204 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN88473%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for AN88473: 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD10151%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for DD10151: 2
2026-03-27 20:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c348bac0-eb38-554e-a843-3c6e0e49497c with identifier: DD10151
2026-03-27 20:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c348bac0-eb38-554e-a843-3c6e0e49497c with scrape type 2
2026-03-27 20:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c348bac0-eb38-554e-a843-3c6e0e49497c with scrape type 2
2026-03-27 20:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c348bac0-eb38-554e-a843-3c6e0e49497c, identifier: DD10151
2026-03-27 20:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c348bac0-eb38-554e-a843-3c6e0e49497c with identifier: DD10151
2026-03-27 20:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c348bac0-eb38-554e-a843-3c6e0e49497c with identifier: DD10151
2026-03-27 20:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c348bac0-eb38-554e-a843-3c6e0e49497c with identifier: DD10151 to the API
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:33:19Z',
 'fuel_type': 'diesel',
 'id': 'c348bac0-eb38-554e-a843-3c6e0e49497c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD10151',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 77610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-21',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2021}
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD10151%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Saving data for DD10151: {'auction_closing_time': 1774715599.0, 'created_time': 1774438594.765823, 'last_price_update_time': 1774643803.438251}
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD10151') HTTP/1.1" 204 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH59922%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for TH59922: 2
2026-03-27 20:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3f1784-a1e6-514f-b74b-70c10cc01d66 with identifier: TH59922
2026-03-27 20:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3f1784-a1e6-514f-b74b-70c10cc01d66 with scrape type 2
2026-03-27 20:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f3f1784-a1e6-514f-b74b-70c10cc01d66 with scrape type 2
2026-03-27 20:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f3f1784-a1e6-514f-b74b-70c10cc01d66, identifier: TH59922
2026-03-27 20:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f3f1784-a1e6-514f-b74b-70c10cc01d66 with identifier: TH59922
2026-03-27 20:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f3f1784-a1e6-514f-b74b-70c10cc01d66 with identifier: TH59922
2026-03-27 20:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f3f1784-a1e6-514f-b74b-70c10cc01d66 with identifier: TH59922 to the API
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:54Z',
 'fuel_type': 'diesel',
 'id': '4f3f1784-a1e6-514f-b74b-70c10cc01d66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH59922',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 67374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 1.5 D-4D L2 Family',
 'transmission': 'manual',
 'trim': 'L2 Family',
 'year': 2019}
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH59922%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Saving data for TH59922: {'auction_closing_time': 1774714614.0, 'created_time': 1774438600.200349, 'last_price_update_time': 1774643803.840382}
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH59922') HTTP/1.1" 204 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for ZU13483: 1
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ74735%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for CZ74735: 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ90167%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for YZ90167: 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for RV20515: 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS47672%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for VS47672: 0
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for AA49507: 1
2026-03-27 20:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:43 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ90658%27 HTTP/1.1" 200 None
2026-03-27 20:36:43 [auto1.be] INFO: Scrape type for BZ90658: 0
2026-03-27 20:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU13483/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:44 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ31869%27 HTTP/1.1" 200 None
2026-03-27 20:36:44 [auto1.be] INFO: Scrape type for JZ31869: 0
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK49914%27 HTTP/1.1" 200 None
2026-03-27 20:36:44 [auto1.be] INFO: Scrape type for YK49914: 0
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-27 20:36:44 [auto1.be] INFO: Scrape type for BN53670: 0
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-27 20:36:44 [auto1.be] INFO: Scrape type for TG38013: 0
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-27 20:36:44 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-27 20:36:44 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for NN42676: 2
2026-03-27 20:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676
2026-03-27 20:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with scrape type 2
2026-03-27 20:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with scrape type 2
2026-03-27 20:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a, identifier: NN42676
2026-03-27 20:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676
2026-03-27 20:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676
2026-03-27 20:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676 to the API
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:23:41Z',
 'fuel_type': 'diesel',
 'id': '61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN42676',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 200663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Saving data for NN42676: {'auction_closing_time': 1774715021.0, 'created_time': 1774039010.613893, 'last_price_update_time': 1774643805.357351}
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN42676') HTTP/1.1" 204 0
2026-03-27 20:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for GC32489: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for AN69845: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP70532%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for WP70532: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH50870%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for AH50870: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF91319%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for TF91319: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-27 20:36:45 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-27 20:36:45 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-27 20:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA49507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:46 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS30497%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for KS30497: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08447%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for GU08447: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE01545%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for SE01545: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF05397%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for JF05397: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV64637%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for ZV64637: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS12412%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for JS12412: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW35122%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for YW35122: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP65458%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for VP65458: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK31036%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for XK31036: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for TH69152: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM09750%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for UM09750: 1
2026-03-27 20:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM78271%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for KM78271: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET07668%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for ET07668: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE24792%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for WE24792: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP41494%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for SP41494: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA31821%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [auto1.be] INFO: Scrape type for YA31821: 0
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-27 20:36:46 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-27 20:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU13483> (referer: https://www.auto1.com/v1/car-details-view/ZU13483/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA49507> (referer: https://www.auto1.com/v1/car-details-view/AA49507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-27 20:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with scrape type 1
2026-03-27 20:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_fa887e966cc3d0eff4e37b91b07df51f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fa887e966cc3d0eff4e37b91b07df51f.jpg not downloaded yet
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_bb06092157b73164df779166716bd638.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_bb06092157b73164df779166716bd638.jpg not downloaded yet
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_e3e2bd997e10cd70dfa90756de93c6df.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_e3e2bd997e10cd70dfa90756de93c6df.jpg not downloaded yet
2026-03-27 20:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-27 20:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113c6d87-a1cf-5b58-b394-de32dd3d7393 with scrape type 1
2026-03-27 20:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_a80491ab3be27c969c79843b889dfa96.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a80491ab3be27c969c79843b889dfa96.jpg not downloaded yet
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_171605a279b05ca67e08408f0ce6a218.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_171605a279b05ca67e08408f0ce6a218.jpg not downloaded yet
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_1888662b496c4edcd7e40995529bb805.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_1888662b496c4edcd7e40995529bb805.jpg not downloaded yet
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_1cb2f6f15cdd68d4736cd52c3252ba72.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_1cb2f6f15cdd68d4736cd52c3252ba72.jpg not downloaded yet
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_f55389b408491423f9e52a0207f6d630.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f55389b408491423f9e52a0207f6d630.jpg not downloaded yet
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_486da3611f5afb3f311c7da61a87c413.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_486da3611f5afb3f311c7da61a87c413.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_bb06092157b73164df779166716bd638.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_37d30174407d022ffbffc38ab19ffc20.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_37d30174407d022ffbffc38ab19ffc20.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_e3e2bd997e10cd70dfa90756de93c6df.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_7cccf02282dddf3e66067058c8df1bc0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_7cccf02282dddf3e66067058c8df1bc0.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a80491ab3be27c969c79843b889dfa96.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_61ea26f0fcaa334e3587d43c7f5b42fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_61ea26f0fcaa334e3587d43c7f5b42fa.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_171605a279b05ca67e08408f0ce6a218.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_fd9d99d56f19ce0cadeecb7fd6a2dbc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fd9d99d56f19ce0cadeecb7fd6a2dbc3.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_1888662b496c4edcd7e40995529bb805.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_a643101366cea1cbd6acf0fc4c7ea95c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a643101366cea1cbd6acf0fc4c7ea95c.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_1cb2f6f15cdd68d4736cd52c3252ba72.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_065add25571797811afd875ef78c4743.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_065add25571797811afd875ef78c4743.jpg not downloaded yet
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_3766f89bebc0043d446f7efdb5f1943f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_3766f89bebc0043d446f7efdb5f1943f.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f55389b408491423f9e52a0207f6d630.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_486da3611f5afb3f311c7da61a87c413.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_8b5cd9162c737ab013db68363b52c85f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_8b5cd9162c737ab013db68363b52c85f.jpg not downloaded yet
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fcd650>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_bb06092157b73164df779166716bd638.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_bb06092157b73164df779166716bd638.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_bc297feed781702367ba770122d48fa4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_bc297feed781702367ba770122d48fa4.jpg not downloaded yet
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c5f510>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_e3e2bd997e10cd70dfa90756de93c6df.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_e3e2bd997e10cd70dfa90756de93c6df.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_37d30174407d022ffbffc38ab19ffc20.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fd9d99d56f19ce0cadeecb7fd6a2dbc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_7cccf02282dddf3e66067058c8df1bc0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c4a890>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_a80491ab3be27c969c79843b889dfa96.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a80491ab3be27c969c79843b889dfa96.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_d7e0c993843fbb9c5bdb0b7fe486fa73.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_d7e0c993843fbb9c5bdb0b7fe486fa73.jpg not downloaded yet
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce0a50>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_171605a279b05ca67e08408f0ce6a218.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_171605a279b05ca67e08408f0ce6a218.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033344d0>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_1888662b496c4edcd7e40995529bb805.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_1888662b496c4edcd7e40995529bb805.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903345c90>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_1cb2f6f15cdd68d4736cd52c3252ba72.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_1cb2f6f15cdd68d4736cd52c3252ba72.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912716c90>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_f55389b408491423f9e52a0207f6d630.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f55389b408491423f9e52a0207f6d630.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903332790>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_486da3611f5afb3f311c7da61a87c413.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_486da3611f5afb3f311c7da61a87c413.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_61ea26f0fcaa334e3587d43c7f5b42fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_065add25571797811afd875ef78c4743.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_f59ae9a68ae742b8a599afc25b4e4b7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f59ae9a68ae742b8a599afc25b4e4b7c.jpg not downloaded yet
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_3766f89bebc0043d446f7efdb5f1943f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a643101366cea1cbd6acf0fc4c7ea95c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903311710>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_37d30174407d022ffbffc38ab19ffc20.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_37d30174407d022ffbffc38ab19ffc20.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033213d0>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_fd9d99d56f19ce0cadeecb7fd6a2dbc3.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fd9d99d56f19ce0cadeecb7fd6a2dbc3.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ccae10>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_7cccf02282dddf3e66067058c8df1bc0.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_7cccf02282dddf3e66067058c8df1bc0.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_8b5cd9162c737ab013db68363b52c85f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM09750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903320290>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_61ea26f0fcaa334e3587d43c7f5b42fa.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_61ea26f0fcaa334e3587d43c7f5b42fa.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6e310>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_065add25571797811afd875ef78c4743.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_065add25571797811afd875ef78c4743.jpg saved to cache
2026-03-27 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e867d0>
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_3766f89bebc0043d446f7efdb5f1943f.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_3766f89bebc0043d446f7efdb5f1943f.jpg saved to cache
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e95b50>
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_a643101366cea1cbd6acf0fc4c7ea95c.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a643101366cea1cbd6acf0fc4c7ea95c.jpg saved to cache
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_bc297feed781702367ba770122d48fa4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_d7e0c993843fbb9c5bdb0b7fe486fa73.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cb8290>
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_8b5cd9162c737ab013db68363b52c85f.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_8b5cd9162c737ab013db68363b52c85f.jpg saved to cache
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f59ae9a68ae742b8a599afc25b4e4b7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cd9fd0>
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_bc297feed781702367ba770122d48fa4.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_bc297feed781702367ba770122d48fa4.jpg saved to cache
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:48 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eac950>
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_d7e0c993843fbb9c5bdb0b7fe486fa73.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_d7e0c993843fbb9c5bdb0b7fe486fa73.jpg saved to cache
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS83423%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for MS83423: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ35563%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for RJ35563: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for NJ53644: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW54495%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for KW54495: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-27 20:36:48 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW19960%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Scrape type for EW19960: 2
2026-03-27 20:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0ab766-4e1f-57b4-a92a-6f5b041a5c94 with identifier: EW19960
2026-03-27 20:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0ab766-4e1f-57b4-a92a-6f5b041a5c94 with scrape type 2
2026-03-27 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c0ab766-4e1f-57b4-a92a-6f5b041a5c94 with scrape type 2
2026-03-27 20:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c0ab766-4e1f-57b4-a92a-6f5b041a5c94, identifier: EW19960
2026-03-27 20:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c0ab766-4e1f-57b4-a92a-6f5b041a5c94 with identifier: EW19960
2026-03-27 20:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c0ab766-4e1f-57b4-a92a-6f5b041a5c94 with identifier: EW19960
2026-03-27 20:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c0ab766-4e1f-57b4-a92a-6f5b041a5c94 with identifier: EW19960 to the API
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:11:45Z',
 'fuel_type': 'diesel',
 'id': '2c0ab766-4e1f-57b4-a92a-6f5b041a5c94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW19960',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 198046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-30',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2015}
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW19960%27 HTTP/1.1" 200 None
2026-03-27 20:36:48 [auto1.be] INFO: Saving data for EW19960: {'auction_closing_time': 1774714305.0, 'created_time': 1774438596.008949, 'last_price_update_time': 1774643808.969172}
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EW19960') HTTP/1.1" 204 0
2026-03-27 20:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL30706%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for VL30706: 0
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44813%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for DT44813: 0
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS77634%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for GS77634: 0
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH29158%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for NH29158: 0
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY53822%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for DY53822: 0
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA35148%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for RA35148: 2
2026-03-27 20:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f97e69b-07b5-52d9-9f16-7a59097b4af6 with identifier: RA35148
2026-03-27 20:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f97e69b-07b5-52d9-9f16-7a59097b4af6 with scrape type 2
2026-03-27 20:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f97e69b-07b5-52d9-9f16-7a59097b4af6 with scrape type 2
2026-03-27 20:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f97e69b-07b5-52d9-9f16-7a59097b4af6, identifier: RA35148
2026-03-27 20:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fa887e966cc3d0eff4e37b91b07df51f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f97e69b-07b5-52d9-9f16-7a59097b4af6 with identifier: RA35148
2026-03-27 20:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f97e69b-07b5-52d9-9f16-7a59097b4af6 with identifier: RA35148
2026-03-27 20:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f97e69b-07b5-52d9-9f16-7a59097b4af6 with identifier: RA35148 to the API
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:29:28Z',
 'fuel_type': 'diesel',
 'id': '4f97e69b-07b5-52d9-9f16-7a59097b4af6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA35148',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 158842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-10',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA35148%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Saving data for RA35148: {'auction_closing_time': 1774715368.0, 'created_time': 1774438548.242218, 'last_price_update_time': 1774643809.549156}
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA35148') HTTP/1.1" 204 0
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-27 20:36:49 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-27 20:36:49 [auto1.be] INFO: Scrape type for GF59002: 0
2026-03-27 20:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9da10>
2026-03-27 20:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F7e%252F557e780099f6cd274c54b7c448938c30%252Fpa%252FAA49507_f59ae9a68ae742b8a599afc25b4e4b7c.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f59ae9a68ae742b8a599afc25b4e4b7c.jpg saved to cache
2026-03-27 20:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 113c6d87-a1cf-5b58-b394-de32dd3d7393
2026-03-27 20:36:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 113c6d87-a1cf-5b58-b394-de32dd3d7393, skipping ID generation
2026-03-27 20:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113c6d87-a1cf-5b58-b394-de32dd3d7393 with scrape type 1
2026-03-27 20:36:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 113c6d87-a1cf-5b58-b394-de32dd3d7393 sending to next pipeline
2026-03-27 20:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 113c6d87-a1cf-5b58-b394-de32dd3d7393, identifier: AA49507
2026-03-27 20:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-27 20:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507
2026-03-27 20:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 113c6d87-a1cf-5b58-b394-de32dd3d7393 with identifier: AA49507 to the API
2026-03-27 20:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f59ae9a68ae742b8a599afc25b4e4b7c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:52:13Z',
 'fuel_type': 'petrol',
 'id': '113c6d87-a1cf-5b58-b394-de32dd3d7393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA49507',
 'listing': 'auction',
 'location': 'BE, Drogenbos',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 169803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 29,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a80491ab3be27c969c79843b889dfa96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_1888662b496c4edcd7e40995529bb805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f55389b408491423f9e52a0207f6d630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_37d30174407d022ffbffc38ab19ffc20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_61ea26f0fcaa334e3587d43c7f5b42fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_a643101366cea1cbd6acf0fc4c7ea95c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_3766f89bebc0043d446f7efdb5f1943f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_bc297feed781702367ba770122d48fa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_d7e0c993843fbb9c5bdb0b7fe486fa73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_113c6d87-a1cf-5b58-b394-de32dd3d7393/113c6d87-a1cf-5b58-b394-de32dd3d7393_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/7e/557e780099f6cd274c54b7c448938c30/pa/AA49507_f59ae9a68ae742b8a599afc25b4e4b7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2008}
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [auto1.be] INFO: Saving data for AA49507: {'created_time': 1774643810.103388, 'last_price_update_time': 1774643810.103399, 'auction_closing_time': 1774716733.0}
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AA49507') HTTP/1.1" 204 0
2026-03-27 20:36:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:36:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:36:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d18b10>
2026-03-27 20:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fd0%252Feed0bd803ffe736893fe1839a7845201%252Fpa%252FZU13483_fa887e966cc3d0eff4e37b91b07df51f.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fa887e966cc3d0eff4e37b91b07df51f.jpg saved to cache
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981
2026-03-27 20:36:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981, skipping ID generation
2026-03-27 20:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with scrape type 1
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 sending to next pipeline
2026-03-27 20:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981, identifier: ZU13483
2026-03-27 20:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-27 20:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483
2026-03-27 20:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22e8a7fe-0993-5ecf-a4c0-096bbedfa981 with identifier: ZU13483 to the API
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fa887e966cc3d0eff4e37b91b07df51f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:01:04Z',
 'fuel_type': 'diesel',
 'id': '22e8a7fe-0993-5ecf-a4c0-096bbedfa981',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU13483',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 209620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1804209,
             'Height': 1240,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fa887e966cc3d0eff4e37b91b07df51f.jpg',
             'Width': 1783},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85293,
             'Height': 489,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_bb06092157b73164df779166716bd638.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_e3e2bd997e10cd70dfa90756de93c6df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_171605a279b05ca67e08408f0ce6a218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_1cb2f6f15cdd68d4736cd52c3252ba72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83670,
             'Height': 502,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_486da3611f5afb3f311c7da61a87c413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72391,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_7cccf02282dddf3e66067058c8df1bc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_fd9d99d56f19ce0cadeecb7fd6a2dbc3.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_065add25571797811afd875ef78c4743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e8a7fe-0993-5ecf-a4c0-096bbedfa981/22e8a7fe-0993-5ecf-a4c0-096bbedfa981_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/d0/eed0bd803ffe736893fe1839a7845201/pa/ZU13483_8b5cd9162c737ab013db68363b52c85f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [auto1.be] INFO: Saving data for ZU13483: {'created_time': 1774643810.612907, 'last_price_update_time': 1774643810.612917, 'auction_closing_time': 1774713664.0}
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU13483') HTTP/1.1" 204 0
2026-03-27 20:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM09750> (referer: https://www.auto1.com/v1/car-details-view/UM09750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f49fa8ac-64a5-5a39-b00d-2d86ef109409 with identifier: UM09750
2026-03-27 20:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49fa8ac-64a5-5a39-b00d-2d86ef109409 with scrape type 1
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_f315a7bc7e3a7786da98326a7970780d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f315a7bc7e3a7786da98326a7970780d.jpg not downloaded yet
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_c6e0762f708efe5cc4752b06b1d78ac4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_c6e0762f708efe5cc4752b06b1d78ac4.jpg not downloaded yet
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_1fb4afa16ad6e0eb742b34918a717cd7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_1fb4afa16ad6e0eb742b34918a717cd7.jpg not downloaded yet
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_f754ebd4c86dcac26d312813cc617a36.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f754ebd4c86dcac26d312813cc617a36.jpg not downloaded yet
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_820d94d5484a7d1eeb3387180d81c00d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_820d94d5484a7d1eeb3387180d81c00d.jpg not downloaded yet
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_a5e974832c8d2d863152eb4815215fda.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_a5e974832c8d2d863152eb4815215fda.jpg not downloaded yet
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_06a9f483cf6ebd85999d5212498cf33a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_06a9f483cf6ebd85999d5212498cf33a.jpg not downloaded yet
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_8bcbdfdcfa3b1e199240137c066bd588.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8bcbdfdcfa3b1e199240137c066bd588.jpg not downloaded yet
2026-03-27 20:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_c6e0762f708efe5cc4752b06b1d78ac4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_8ba361a495057413efe3f12a65683e72.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8ba361a495057413efe3f12a65683e72.jpg not downloaded yet
2026-03-27 20:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f754ebd4c86dcac26d312813cc617a36.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_1fb4afa16ad6e0eb742b34918a717cd7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_ea2db150306a6a612e890a87dafcaa5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_ea2db150306a6a612e890a87dafcaa5f.jpg not downloaded yet
2026-03-27 20:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_820d94d5484a7d1eeb3387180d81c00d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_a5e974832c8d2d863152eb4815215fda.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_ea2db150306a6a612e890a87dafcaa5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8ba361a495057413efe3f12a65683e72.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_06a9f483cf6ebd85999d5212498cf33a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8bcbdfdcfa3b1e199240137c066bd588.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e9c0d0>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_c6e0762f708efe5cc4752b06b1d78ac4.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_c6e0762f708efe5cc4752b06b1d78ac4.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cd3050>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_f754ebd4c86dcac26d312813cc617a36.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f754ebd4c86dcac26d312813cc617a36.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c8be10>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_1fb4afa16ad6e0eb742b34918a717cd7.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_1fb4afa16ad6e0eb742b34918a717cd7.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2f150>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_820d94d5484a7d1eeb3387180d81c00d.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_820d94d5484a7d1eeb3387180d81c00d.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9e950>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_a5e974832c8d2d863152eb4815215fda.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_a5e974832c8d2d863152eb4815215fda.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fdef50>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_ea2db150306a6a612e890a87dafcaa5f.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_ea2db150306a6a612e890a87dafcaa5f.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dac5d0>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_8ba361a495057413efe3f12a65683e72.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8ba361a495057413efe3f12a65683e72.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f63650>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_06a9f483cf6ebd85999d5212498cf33a.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_06a9f483cf6ebd85999d5212498cf33a.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903daf710>
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_8bcbdfdcfa3b1e199240137c066bd588.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8bcbdfdcfa3b1e199240137c066bd588.jpg saved to cache
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Scrape type for PV35906: 0
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB43323%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Scrape type for EB43323: 0
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Scrape type for SR71847: 0
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: US70780
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH06099%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Scrape type for JH06099: 0
2026-03-27 20:36:51 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ27954%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Scrape type for WJ27954: 2
2026-03-27 20:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f56e252-c922-511c-8802-08a7255854f8 with identifier: WJ27954
2026-03-27 20:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f56e252-c922-511c-8802-08a7255854f8 with scrape type 2
2026-03-27 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f56e252-c922-511c-8802-08a7255854f8 with scrape type 2
2026-03-27 20:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f56e252-c922-511c-8802-08a7255854f8, identifier: WJ27954
2026-03-27 20:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f56e252-c922-511c-8802-08a7255854f8 with identifier: WJ27954
2026-03-27 20:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f56e252-c922-511c-8802-08a7255854f8 with identifier: WJ27954
2026-03-27 20:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f56e252-c922-511c-8802-08a7255854f8 with identifier: WJ27954 to the API
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:36:10Z',
 'fuel_type': 'diesel',
 'id': '1f56e252-c922-511c-8802-08a7255854f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ27954',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 145414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2016}
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ27954%27 HTTP/1.1" 200 None
2026-03-27 20:36:51 [auto1.be] INFO: Saving data for WJ27954: {'auction_closing_time': 1774715770.0, 'created_time': 1774438527.14886, 'last_price_update_time': 1774643811.989195}
2026-03-27 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ27954') HTTP/1.1" 204 0
2026-03-27 20:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR58381%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for TR58381: 2
2026-03-27 20:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd5e59d-c17a-5dfc-a9ea-c9d512d18495 with identifier: TR58381
2026-03-27 20:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cd5e59d-c17a-5dfc-a9ea-c9d512d18495 with scrape type 2
2026-03-27 20:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cd5e59d-c17a-5dfc-a9ea-c9d512d18495 with scrape type 2
2026-03-27 20:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3cd5e59d-c17a-5dfc-a9ea-c9d512d18495, identifier: TR58381
2026-03-27 20:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3cd5e59d-c17a-5dfc-a9ea-c9d512d18495 with identifier: TR58381
2026-03-27 20:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3cd5e59d-c17a-5dfc-a9ea-c9d512d18495 with identifier: TR58381
2026-03-27 20:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3cd5e59d-c17a-5dfc-a9ea-c9d512d18495 with identifier: TR58381 to the API
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:56Z',
 'fuel_type': 'diesel',
 'id': '3cd5e59d-c17a-5dfc-a9ea-c9d512d18495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR58381',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 109842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR58381%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Saving data for TR58381: {'auction_closing_time': 1774713896.0, 'created_time': 1774557330.192855, 'last_price_update_time': 1774643812.482986}
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TR58381') HTTP/1.1" 204 0
2026-03-27 20:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f315a7bc7e3a7786da98326a7970780d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM08929%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for WM08929: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for YN20871: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS04385%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for HS04385: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for FV41606: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN50786%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for YN50786: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM09652%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for CM09652: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-27 20:36:52 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-27 20:36:52 [auto1.be] INFO: Scrape type for KW80684: 2
2026-03-27 20:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-27 20:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with scrape type 2
2026-03-27 20:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with scrape type 2
2026-03-27 20:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9, identifier: KW80684
2026-03-27 20:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-27 20:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684
2026-03-27 20:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 13bd6a3b-311f-5798-9dfb-de19fc97f8c9 with identifier: KW80684 to the API
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:28:25Z',
 'fuel_type': 'diesel',
 'id': '13bd6a3b-311f-5798-9dfb-de19fc97f8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW80684',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'FR-V',
 'odometer': 202431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-11',
 'seller_name': None,
 'title': 'Honda FR-V 2.2 CTDI CTDi Comfort',
 'transmission': 'manual',
 'trim': 'CTDi Comfort',
 'year': 2006}
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-27 20:36:53 [auto1.be] INFO: Saving data for KW80684: {'auction_closing_time': 1774715305.0, 'created_time': 1774557323.389532, 'last_price_update_time': 1774643813.012113}
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW80684') HTTP/1.1" 204 0
2026-03-27 20:36:53 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL97420%27 HTTP/1.1" 200 None
2026-03-27 20:36:53 [auto1.be] INFO: Scrape type for TL97420: 0
2026-03-27 20:36:53 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-27 20:36:53 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-27 20:36:53 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-27 20:36:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:36:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:36:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:36:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:36:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f86550>
2026-03-27 20:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fdf%252F8cdf2fbb8850f9f58a87626ac97fc921%252Fpa%252FUM09750_f315a7bc7e3a7786da98326a7970780d.jpg') HTTP/1.1" 204 0
2026-03-27 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f315a7bc7e3a7786da98326a7970780d.jpg saved to cache
2026-03-27 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f49fa8ac-64a5-5a39-b00d-2d86ef109409
2026-03-27 20:36:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f49fa8ac-64a5-5a39-b00d-2d86ef109409, skipping ID generation
2026-03-27 20:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49fa8ac-64a5-5a39-b00d-2d86ef109409 with scrape type 1
2026-03-27 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f49fa8ac-64a5-5a39-b00d-2d86ef109409 sending to next pipeline
2026-03-27 20:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f49fa8ac-64a5-5a39-b00d-2d86ef109409, identifier: UM09750
2026-03-27 20:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f49fa8ac-64a5-5a39-b00d-2d86ef109409 with identifier: UM09750
2026-03-27 20:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f49fa8ac-64a5-5a39-b00d-2d86ef109409 with identifier: UM09750
2026-03-27 20:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f49fa8ac-64a5-5a39-b00d-2d86ef109409 with identifier: UM09750 to the API
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f315a7bc7e3a7786da98326a7970780d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:02:47Z',
 'fuel_type': 'diesel',
 'id': 'f49fa8ac-64a5-5a39-b00d-2d86ef109409',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM09750',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 161643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3322795,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f315a7bc7e3a7786da98326a7970780d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_c6e0762f708efe5cc4752b06b1d78ac4.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_1fb4afa16ad6e0eb742b34918a717cd7.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_f754ebd4c86dcac26d312813cc617a36.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_820d94d5484a7d1eeb3387180d81c00d.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_a5e974832c8d2d863152eb4815215fda.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_06a9f483cf6ebd85999d5212498cf33a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8bcbdfdcfa3b1e199240137c066bd588.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_8ba361a495057413efe3f12a65683e72.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f49fa8ac-64a5-5a39-b00d-2d86ef109409/f49fa8ac-64a5-5a39-b00d-2d86ef109409_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/df/8cdf2fbb8850f9f58a87626ac97fc921/pa/UM09750_ea2db150306a6a612e890a87dafcaa5f.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM09750%27 HTTP/1.1" 200 None
2026-03-27 20:36:53 [auto1.be] INFO: Saving data for UM09750: {'created_time': 1774643813.692594, 'last_price_update_time': 1774643813.692604, 'auction_closing_time': 1774713767.0}
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM09750') HTTP/1.1" 204 0
2026-03-27 20:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:54 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05336%27 HTTP/1.1" 200 None
2026-03-27 20:36:54 [auto1.be] INFO: Scrape type for GS05336: 0
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU70188%27 HTTP/1.1" 200 None
2026-03-27 20:36:54 [auto1.be] INFO: Scrape type for JU70188: 0
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-27 20:36:54 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK84429%27 HTTP/1.1" 200 None
2026-03-27 20:36:54 [auto1.be] INFO: Scrape type for RK84429: 0
2026-03-27 20:36:54 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK31159%27 HTTP/1.1" 200 None
2026-03-27 20:36:54 [auto1.be] INFO: Scrape type for DK31159: 2
2026-03-27 20:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d12b579-5423-5077-b389-3838b99f6ff5 with identifier: DK31159
2026-03-27 20:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d12b579-5423-5077-b389-3838b99f6ff5 with scrape type 2
2026-03-27 20:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d12b579-5423-5077-b389-3838b99f6ff5 with scrape type 2
2026-03-27 20:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d12b579-5423-5077-b389-3838b99f6ff5, identifier: DK31159
2026-03-27 20:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d12b579-5423-5077-b389-3838b99f6ff5 with identifier: DK31159
2026-03-27 20:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d12b579-5423-5077-b389-3838b99f6ff5 with identifier: DK31159
2026-03-27 20:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d12b579-5423-5077-b389-3838b99f6ff5 with identifier: DK31159 to the API
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:15Z',
 'fuel_type': 'diesel',
 'id': '3d12b579-5423-5077-b389-3838b99f6ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK31159',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 189126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK31159%27 HTTP/1.1" 200 None
2026-03-27 20:36:54 [auto1.be] INFO: Saving data for DK31159: {'auction_closing_time': 1774713915.0, 'created_time': 1774438559.039395, 'last_price_update_time': 1774643814.965262}
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK31159') HTTP/1.1" 204 0
2026-03-27 20:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for SV05686: 2
2026-03-27 20:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-27 20:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with scrape type 2
2026-03-27 20:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with scrape type 2
2026-03-27 20:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f, identifier: SV05686
2026-03-27 20:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-27 20:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686
2026-03-27 20:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a7e7a30-1a97-5eda-99e4-49a3405a0d4f with identifier: SV05686 to the API
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:35:24Z',
 'fuel_type': 'diesel',
 'id': '3a7e7a30-1a97-5eda-99e4-49a3405a0d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV05686',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 206571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2016}
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Saving data for SV05686: {'auction_closing_time': 1774715724.0, 'created_time': 1774557355.409705, 'last_price_update_time': 1774643815.44716}
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV05686') HTTP/1.1" 204 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU76581%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for MU76581: 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45818%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for EJ45818: 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX63908%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for WX63908: 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL53364%27 HTTP/1.1" 200 None
2026-03-27 20:36:55 [auto1.be] INFO: Scrape type for RL53364: 0
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-27 20:36:55 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-27 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:56 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM52966%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for SM52966: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR59063%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for FR59063: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ82774%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for BZ82774: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS18318%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for KS18318: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW21160%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for MW21160: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK67306%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for FK67306: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for TF58036: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE17510%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for KE17510: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for BC32945: 1
2026-03-27 20:36:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-27 20:36:56 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-27 20:36:56 [auto1.be] INFO: Scrape type for UC23117: 2
2026-03-27 20:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-27 20:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69a1ffc-e570-5729-b9e0-495f719664ad with scrape type 2
2026-03-27 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69a1ffc-e570-5729-b9e0-495f719664ad with scrape type 2
2026-03-27 20:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c69a1ffc-e570-5729-b9e0-495f719664ad, identifier: UC23117
2026-03-27 20:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-27 20:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117
2026-03-27 20:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c69a1ffc-e570-5729-b9e0-495f719664ad with identifier: UC23117 to the API
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-28T16:50:35Z',
 'fuel_type': 'petrol',
 'id': 'c69a1ffc-e570-5729-b9e0-495f719664ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC23117',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 48513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-09',
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-27 20:36:57 [auto1.be] INFO: Saving data for UC23117: {'auction_closing_time': 1774716635.0, 'created_time': 1774557330.897999, 'last_price_update_time': 1774643817.344089}
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC23117') HTTP/1.1" 204 0
2026-03-27 20:36:57 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-27 20:36:57 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-27 20:36:57 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-27 20:36:57 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-27 20:36:57 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-27 20:36:57 [auto1.be] INFO: Scrape type for HJ27727: 0
2026-03-27 20:36:57 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP97194%27 HTTP/1.1" 200 None
2026-03-27 20:36:57 [auto1.be] INFO: Scrape type for AP97194: 0
2026-03-27 20:36:57 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-27 20:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:58 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1659 | hits on page: 40
2026-03-27 20:36:58 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP87063%27 HTTP/1.1" 200 None
2026-03-27 20:36:58 [auto1.be] INFO: Scrape type for TP87063: 0
2026-03-27 20:36:58 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-27 20:36:58 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-27 20:36:58 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-27 20:36:58 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-27 20:36:58 [auto1.be] INFO: Scrape type for TX99790: 0
2026-03-27 20:36:58 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL40552%27 HTTP/1.1" 200 None
2026-03-27 20:36:58 [auto1.be] INFO: Scrape type for JL40552: 2
2026-03-27 20:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 053a5f95-b97a-5c3a-a066-415963c8aa6f with identifier: JL40552
2026-03-27 20:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053a5f95-b97a-5c3a-a066-415963c8aa6f with scrape type 2
2026-03-27 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 053a5f95-b97a-5c3a-a066-415963c8aa6f with scrape type 2
2026-03-27 20:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 053a5f95-b97a-5c3a-a066-415963c8aa6f, identifier: JL40552
2026-03-27 20:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 053a5f95-b97a-5c3a-a066-415963c8aa6f with identifier: JL40552
2026-03-27 20:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 053a5f95-b97a-5c3a-a066-415963c8aa6f with identifier: JL40552
2026-03-27 20:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 053a5f95-b97a-5c3a-a066-415963c8aa6f with identifier: JL40552 to the API
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:36:03Z',
 'fuel_type': 'diesel',
 'id': '053a5f95-b97a-5c3a-a066-415963c8aa6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL40552',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 175903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL40552%27 HTTP/1.1" 200 None
2026-03-27 20:36:58 [auto1.be] INFO: Saving data for JL40552: {'auction_closing_time': 1774715763.0, 'created_time': 1774438599.51342, 'last_price_update_time': 1774643818.956652}
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JL40552') HTTP/1.1" 204 0
2026-03-27 20:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB89489%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for AB89489: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF35218%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for AF35218: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG25655%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for WG25655: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT74022%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for XT74022: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for XE18058: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for PN62826: 2
2026-03-27 20:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-27 20:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with scrape type 2
2026-03-27 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with scrape type 2
2026-03-27 20:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc, identifier: PN62826
2026-03-27 20:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-27 20:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826
2026-03-27 20:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f7bdd03-0d22-594a-99ea-d3e40a3907dc with identifier: PN62826 to the API
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:25:42Z',
 'fuel_type': 'diesel',
 'id': '2f7bdd03-0d22-594a-99ea-d3e40a3907dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN62826',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 437968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T Avantgarde',
 'transmission': 'manual',
 'trim': 'T Avantgarde',
 'year': 2007}
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Saving data for PN62826: {'auction_closing_time': 1774715142.0, 'created_time': 1773693391.897711, 'last_price_update_time': 1774643819.528059}
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PN62826') HTTP/1.1" 204 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR44079%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for BR44079: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN27020%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for KN27020: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC35394%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for AC35394: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX10335%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for JX10335: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-27 20:36:59 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-27 20:36:59 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-27 20:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC32945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:00 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:00 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM70865%27 HTTP/1.1" 200 None
2026-03-27 20:37:00 [auto1.be] INFO: Scrape type for HM70865: 0
2026-03-27 20:37:00 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR60731%27 HTTP/1.1" 200 None
2026-03-27 20:37:00 [auto1.be] INFO: Scrape type for RR60731: 0
2026-03-27 20:37:00 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-27 20:37:00 [auto1.be] INFO: Scrape type for VW71513: 0
2026-03-27 20:37:00 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-27 20:37:00 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-27 20:37:00 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-27 20:37:00 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-27 20:37:00 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-27 20:37:00 [auto1.be] INFO: Scrape type for ZH69808: 2
2026-03-27 20:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-27 20:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cf23860-d8c1-57eb-835e-c370a2654844 with scrape type 2
2026-03-27 20:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cf23860-d8c1-57eb-835e-c370a2654844 with scrape type 2
2026-03-27 20:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4cf23860-d8c1-57eb-835e-c370a2654844, identifier: ZH69808
2026-03-27 20:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-27 20:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808
2026-03-27 20:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4cf23860-d8c1-57eb-835e-c370a2654844 with identifier: ZH69808 to the API
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:39:33Z',
 'fuel_type': 'petrol',
 'id': '4cf23860-d8c1-57eb-835e-c370a2654844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH69808',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 87875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Saving data for ZH69808: {'auction_closing_time': 1774715973.0, 'created_time': 1774557332.681902, 'last_price_update_time': 1774643821.048273}
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH69808') HTTP/1.1" 204 0
2026-03-27 20:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR16317%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Scrape type for MR16317: 0
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP38880%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Scrape type for CP38880: 0
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW93174%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Scrape type for VW93174: 2
2026-03-27 20:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5877c903-8f08-5e4a-bca4-d7817403f9a9 with identifier: VW93174
2026-03-27 20:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5877c903-8f08-5e4a-bca4-d7817403f9a9 with scrape type 2
2026-03-27 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5877c903-8f08-5e4a-bca4-d7817403f9a9 with scrape type 2
2026-03-27 20:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5877c903-8f08-5e4a-bca4-d7817403f9a9, identifier: VW93174
2026-03-27 20:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5877c903-8f08-5e4a-bca4-d7817403f9a9 with identifier: VW93174
2026-03-27 20:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5877c903-8f08-5e4a-bca4-d7817403f9a9 with identifier: VW93174
2026-03-27 20:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5877c903-8f08-5e4a-bca4-d7817403f9a9 with identifier: VW93174 to the API
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:12Z',
 'fuel_type': 'diesel',
 'id': '5877c903-8f08-5e4a-bca4-d7817403f9a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW93174',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 251018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW93174%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Saving data for VW93174: {'auction_closing_time': 1774715292.0, 'created_time': 1773909348.773419, 'last_price_update_time': 1774643821.558059}
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW93174') HTTP/1.1" 204 0
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Scrape type for SJ72272: 0
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-27 20:37:01 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB89914%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Scrape type for ZB89914: 2
2026-03-27 20:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 790574cd-3397-5bab-a196-dcda4c115e3b with identifier: ZB89914
2026-03-27 20:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790574cd-3397-5bab-a196-dcda4c115e3b with scrape type 2
2026-03-27 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 790574cd-3397-5bab-a196-dcda4c115e3b with scrape type 2
2026-03-27 20:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 790574cd-3397-5bab-a196-dcda4c115e3b, identifier: ZB89914
2026-03-27 20:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC32945> (referer: https://www.auto1.com/v1/car-details-view/BC32945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 790574cd-3397-5bab-a196-dcda4c115e3b with identifier: ZB89914
2026-03-27 20:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 790574cd-3397-5bab-a196-dcda4c115e3b with identifier: ZB89914
2026-03-27 20:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 790574cd-3397-5bab-a196-dcda4c115e3b with identifier: ZB89914 to the API
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:41:42Z',
 'fuel_type': 'petrol',
 'id': '790574cd-3397-5bab-a196-dcda4c115e3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB89914',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 115214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-04',
 'seller_name': None,
 'title': 'Peugeot 108 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB89914%27 HTTP/1.1" 200 None
2026-03-27 20:37:01 [auto1.be] INFO: Saving data for ZB89914: {'auction_closing_time': 1774716102.0, 'created_time': 1774438608.144741, 'last_price_update_time': 1774643821.94739}
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZB89914') HTTP/1.1" 204 0
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC75548%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [auto1.be] INFO: Scrape type for ZC75548: 0
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ85398%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [auto1.be] INFO: Scrape type for FJ85398: 2
2026-03-27 20:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8595a31-d750-5d74-80d1-cfa2464f8545 with identifier: FJ85398
2026-03-27 20:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8595a31-d750-5d74-80d1-cfa2464f8545 with scrape type 2
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8595a31-d750-5d74-80d1-cfa2464f8545 with scrape type 2
2026-03-27 20:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8595a31-d750-5d74-80d1-cfa2464f8545, identifier: FJ85398
2026-03-27 20:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8595a31-d750-5d74-80d1-cfa2464f8545 with identifier: FJ85398
2026-03-27 20:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8595a31-d750-5d74-80d1-cfa2464f8545 with identifier: FJ85398
2026-03-27 20:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8595a31-d750-5d74-80d1-cfa2464f8545 with identifier: FJ85398 to the API
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:16:39Z',
 'fuel_type': 'petrol',
 'id': 'e8595a31-d750-5d74-80d1-cfa2464f8545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ85398',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 135919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-10-22',
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.6 Cabrio',
 'transmission': 'manual',
 'trim': 'Cabrio',
 'year': 2000}
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ85398%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [auto1.be] INFO: Saving data for FJ85398: {'auction_closing_time': 1774714599.0, 'created_time': 1774471085.735098, 'last_price_update_time': 1774643822.4511}
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ85398') HTTP/1.1" 204 0
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB02189%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [auto1.be] INFO: Scrape type for CB02189: 1
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-27 20:37:02 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC39555%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [auto1.be] INFO: Scrape type for PC39555: 2
2026-03-27 20:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2cf1095-7473-57a6-b662-a9d29312034d with identifier: PC39555
2026-03-27 20:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2cf1095-7473-57a6-b662-a9d29312034d with scrape type 2
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2cf1095-7473-57a6-b662-a9d29312034d with scrape type 2
2026-03-27 20:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2cf1095-7473-57a6-b662-a9d29312034d, identifier: PC39555
2026-03-27 20:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-27 20:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e536945-6c61-5a8b-b098-29e70071a9f5 with scrape type 1
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e536945-6c61-5a8b-b098-29e70071a9f5
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_a65102743d5f8a19675f54879507f37a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_a65102743d5f8a19675f54879507f37a.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_9d66f4eb88389b7c00dee5a24c42a308.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_9d66f4eb88389b7c00dee5a24c42a308.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_a0d38aa2db06f87893d70b9c7c867dbf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_a0d38aa2db06f87893d70b9c7c867dbf.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_7215123aba5849d0efc8d667133f5cda.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_7215123aba5849d0efc8d667133f5cda.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_37b411a9c95426f3671162c4fe67f84b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_37b411a9c95426f3671162c4fe67f84b.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_1e064595a2818f755554546de134f838.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_1e064595a2818f755554546de134f838.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_816c2008aea399add8ec24c43b87fd0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_816c2008aea399add8ec24c43b87fd0f.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_de5c53ebd15c121fbe8ff207c0530790.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_de5c53ebd15c121fbe8ff207c0530790.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_3c5278c87fffaf0e0d60b814f9744404.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_3c5278c87fffaf0e0d60b814f9744404.jpg already downloaded
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fba%252F56ba225c54ea2c6a2b427cbf05dd3462%252Fpa%252FBC32945_0db5c078762d5606de102e9dfc77ad28.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_0db5c078762d5606de102e9dfc77ad28.jpg already downloaded
2026-03-27 20:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e536945-6c61-5a8b-b098-29e70071a9f5, identifier: BC32945
2026-03-27 20:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2cf1095-7473-57a6-b662-a9d29312034d with identifier: PC39555
2026-03-27 20:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2cf1095-7473-57a6-b662-a9d29312034d with identifier: PC39555
2026-03-27 20:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2cf1095-7473-57a6-b662-a9d29312034d with identifier: PC39555 to the API
2026-03-27 20:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:37:00Z',
 'fuel_type': 'diesel',
 'id': 'd2cf1095-7473-57a6-b662-a9d29312034d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC39555',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 214023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-15',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Zenith',
 'transmission': 'manual',
 'trim': 'Zenith',
 'year': 2012}
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC39555%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Saving data for PC39555: {'auction_closing_time': 1774715820.0, 'created_time': 1774471099.897472, 'last_price_update_time': 1774643823.150948}
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC39555') HTTP/1.1" 204 0
2026-03-27 20:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-27 20:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945
2026-03-27 20:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e536945-6c61-5a8b-b098-29e70071a9f5 with identifier: BC32945 to the API
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC32945>
{'auction_title': '',
 'c_o_2_emission_value': 309,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '3.0L',
 'engine_horse_power': 350,
 'expiration_date': '2026-03-28T16:26:00Z',
 'fuel_type': 'petrol',
 'id': '0e536945-6c61-5a8b-b098-29e70071a9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC32945',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 110020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_a65102743d5f8a19675f54879507f37a.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_9d66f4eb88389b7c00dee5a24c42a308.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_a0d38aa2db06f87893d70b9c7c867dbf.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_7215123aba5849d0efc8d667133f5cda.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_37b411a9c95426f3671162c4fe67f84b.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_1e064595a2818f755554546de134f838.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_816c2008aea399add8ec24c43b87fd0f.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_de5c53ebd15c121fbe8ff207c0530790.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_3c5278c87fffaf0e0d60b814f9744404.jpg',
                'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_0db5c078762d5606de102e9dfc77ad28.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_a65102743d5f8a19675f54879507f37a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_9d66f4eb88389b7c00dee5a24c42a308.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_a0d38aa2db06f87893d70b9c7c867dbf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_7215123aba5849d0efc8d667133f5cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_37b411a9c95426f3671162c4fe67f84b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_1e064595a2818f755554546de134f838.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_816c2008aea399add8ec24c43b87fd0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2563983,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_de5c53ebd15c121fbe8ff207c0530790.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_3c5278c87fffaf0e0d60b814f9744404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e536945-6c61-5a8b-b098-29e70071a9f5/0e536945-6c61-5a8b-b098-29e70071a9f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2203484,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/ba/56ba225c54ea2c6a2b427cbf05dd3462/pa/BC32945_0db5c078762d5606de102e9dfc77ad28.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 TwinTurbo Gran Lusso Q4',
 'transmission': 'automatic',
 'trim': 'Gran Lusso Q4',
 'year': 2019}
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Saving data for BC32945: {'created_time': 1774643823.52297, 'last_price_update_time': 1774643823.522979, 'auction_closing_time': 1774715160.0}
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC32945') HTTP/1.1" 204 0
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Scrape type for GN71373: 0
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Scrape type for KV01738: 1
2026-03-27 20:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN84271%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Scrape type for XN84271: 2
2026-03-27 20:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5025f64c-8c06-5202-9a80-4b141a2ca80c with identifier: XN84271
2026-03-27 20:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5025f64c-8c06-5202-9a80-4b141a2ca80c with scrape type 2
2026-03-27 20:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5025f64c-8c06-5202-9a80-4b141a2ca80c with scrape type 2
2026-03-27 20:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5025f64c-8c06-5202-9a80-4b141a2ca80c, identifier: XN84271
2026-03-27 20:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5025f64c-8c06-5202-9a80-4b141a2ca80c with identifier: XN84271
2026-03-27 20:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5025f64c-8c06-5202-9a80-4b141a2ca80c with identifier: XN84271
2026-03-27 20:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5025f64c-8c06-5202-9a80-4b141a2ca80c with identifier: XN84271 to the API
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:05:47Z',
 'fuel_type': 'petrol',
 'id': '5025f64c-8c06-5202-9a80-4b141a2ca80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN84271',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 305295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-17',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN84271%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Saving data for XN84271: {'auction_closing_time': 1774713947.0, 'created_time': 1773137811.753109, 'last_price_update_time': 1774643823.930776}
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN84271') HTTP/1.1" 204 0
2026-03-27 20:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW03040%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Scrape type for HW03040: 0
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-27 20:37:03 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-27 20:37:03 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:03 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-27 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-27 20:37:04 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-27 20:37:04 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB63888%27 HTTP/1.1" 200 None
2026-03-27 20:37:04 [auto1.be] INFO: Scrape type for FB63888: 2
2026-03-27 20:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e7f395-2edd-571f-b8c2-3c7ba8ef7185 with identifier: FB63888
2026-03-27 20:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e7f395-2edd-571f-b8c2-3c7ba8ef7185 with scrape type 2
2026-03-27 20:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09e7f395-2edd-571f-b8c2-3c7ba8ef7185 with scrape type 2
2026-03-27 20:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09e7f395-2edd-571f-b8c2-3c7ba8ef7185, identifier: FB63888
2026-03-27 20:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09e7f395-2edd-571f-b8c2-3c7ba8ef7185 with identifier: FB63888
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 20:37:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09e7f395-2edd-571f-b8c2-3c7ba8ef7185 with identifier: FB63888
2026-03-27 20:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09e7f395-2edd-571f-b8c2-3c7ba8ef7185 with identifier: FB63888 to the API
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:26:39Z',
 'fuel_type': 'diesel',
 'id': '09e7f395-2edd-571f-b8c2-3c7ba8ef7185',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB63888',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 374625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-11',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB63888%27 HTTP/1.1" 200 None
2026-03-27 20:37:04 [auto1.be] INFO: Saving data for FB63888: {'auction_closing_time': 1774715199.0, 'created_time': 1773134088.972739, 'last_price_update_time': 1774643824.672676}
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FB63888') HTTP/1.1" 204 0
2026-03-27 20:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:04 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-27 20:37:04 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-27 20:37:04 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH93162%27 HTTP/1.1" 200 None
2026-03-27 20:37:04 [auto1.be] INFO: Scrape type for YH93162: 2
2026-03-27 20:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ab7439-d9f2-5866-93b2-069d58c4ab65 with identifier: YH93162
2026-03-27 20:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ab7439-d9f2-5866-93b2-069d58c4ab65 with scrape type 2
2026-03-27 20:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65ab7439-d9f2-5866-93b2-069d58c4ab65 with scrape type 2
2026-03-27 20:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65ab7439-d9f2-5866-93b2-069d58c4ab65, identifier: YH93162
2026-03-27 20:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65ab7439-d9f2-5866-93b2-069d58c4ab65 with identifier: YH93162
2026-03-27 20:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65ab7439-d9f2-5866-93b2-069d58c4ab65 with identifier: YH93162
2026-03-27 20:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65ab7439-d9f2-5866-93b2-069d58c4ab65 with identifier: YH93162 to the API
2026-03-27 20:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:56Z',
 'fuel_type': 'diesel',
 'id': '65ab7439-d9f2-5866-93b2-069d58c4ab65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH93162',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 75590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 d BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2017}
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH93162%27 HTTP/1.1" 200 None
2026-03-27 20:37:05 [auto1.be] INFO: Saving data for YH93162: {'auction_closing_time': 1774714136.0, 'created_time': 1773240140.680045, 'last_price_update_time': 1774643825.160275}
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH93162') HTTP/1.1" 204 0
2026-03-27 20:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB02189/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-27 20:37:05 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE27589%27 HTTP/1.1" 200 None
2026-03-27 20:37:05 [auto1.be] INFO: Scrape type for HE27589: 1
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-27 20:37:05 [auto1.be] INFO: Scrape type for XJ49438: 2
2026-03-27 20:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-27 20:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc460453-e314-5f70-916c-d01b8499e491 with scrape type 2
2026-03-27 20:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc460453-e314-5f70-916c-d01b8499e491 with scrape type 2
2026-03-27 20:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc460453-e314-5f70-916c-d01b8499e491, identifier: XJ49438
2026-03-27 20:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-27 20:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438
2026-03-27 20:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc460453-e314-5f70-916c-d01b8499e491 with identifier: XJ49438 to the API
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:45:48Z',
 'fuel_type': 'petrol',
 'id': 'dc460453-e314-5f70-916c-d01b8499e491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ49438',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'BMW 1er 116i Edition M Sport Shadow',
 'transmission': 'manual',
 'trim': 'Edition M Sport Shadow',
 'year': 2019}
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-27 20:37:05 [auto1.be] INFO: Saving data for XJ49438: {'auction_closing_time': 1774716348.0, 'created_time': 1773434128.408951, 'last_price_update_time': 1774643825.617797}
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ49438') HTTP/1.1" 204 0
2026-03-27 20:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:05 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-27 20:37:05 [auto1.be] INFO: Scrape type for FF99790: 2
2026-03-27 20:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-27 20:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc4450d-a9da-53ea-b379-ffb0596c3043 with scrape type 2
2026-03-27 20:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc4450d-a9da-53ea-b379-ffb0596c3043 with scrape type 2
2026-03-27 20:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fc4450d-a9da-53ea-b379-ffb0596c3043, identifier: FF99790
2026-03-27 20:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-27 20:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790
2026-03-27 20:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fc4450d-a9da-53ea-b379-ffb0596c3043 with identifier: FF99790 to the API
2026-03-27 20:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:31:19Z',
 'fuel_type': 'petrol',
 'id': '6fc4450d-a9da-53ea-b379-ffb0596c3043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF99790',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 112770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-27 20:37:06 [auto1.be] INFO: Saving data for FF99790: {'auction_closing_time': 1774715479.0, 'created_time': 1774557417.582953, 'last_price_update_time': 1774643826.142438}
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF99790') HTTP/1.1" 204 0
2026-03-27 20:37:06 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-27 20:37:06 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-27 20:37:06 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-27 20:37:06 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC02969%27 HTTP/1.1" 200 None
2026-03-27 20:37:06 [auto1.be] INFO: Scrape type for TC02969: 2
2026-03-27 20:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e07594f4-7d52-556e-972d-6a5215563b1b with identifier: TC02969
2026-03-27 20:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e07594f4-7d52-556e-972d-6a5215563b1b with scrape type 2
2026-03-27 20:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e07594f4-7d52-556e-972d-6a5215563b1b with scrape type 2
2026-03-27 20:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e07594f4-7d52-556e-972d-6a5215563b1b, identifier: TC02969
2026-03-27 20:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e07594f4-7d52-556e-972d-6a5215563b1b with identifier: TC02969
2026-03-27 20:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e07594f4-7d52-556e-972d-6a5215563b1b with identifier: TC02969
2026-03-27 20:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e07594f4-7d52-556e-972d-6a5215563b1b with identifier: TC02969 to the API
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:20:22Z',
 'fuel_type': 'diesel',
 'id': 'e07594f4-7d52-556e-972d-6a5215563b1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC02969',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Navara Pick-up',
 'odometer': 266945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-03',
 'seller_name': None,
 'title': 'Nissan Navara Pick-up 2.5 dCi Doppelkabine Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Doppelkabine Comfort 4x4',
 'year': 2007}
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC02969%27 HTTP/1.1" 200 None
2026-03-27 20:37:06 [auto1.be] INFO: Saving data for TC02969: {'auction_closing_time': 1774714822.0, 'created_time': 1773866530.268061, 'last_price_update_time': 1774643826.562086}
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC02969') HTTP/1.1" 204 0
2026-03-27 20:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:06 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA95611%27 HTTP/1.1" 200 None
2026-03-27 20:37:06 [auto1.be] INFO: Scrape type for MA95611: 0
2026-03-27 20:37:06 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN67239%27 HTTP/1.1" 200 None
2026-03-27 20:37:06 [auto1.be] INFO: Scrape type for YN67239: 2
2026-03-27 20:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da459fb-92dd-57a3-9dc3-c538506c4ea8 with identifier: YN67239
2026-03-27 20:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da459fb-92dd-57a3-9dc3-c538506c4ea8 with scrape type 2
2026-03-27 20:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da459fb-92dd-57a3-9dc3-c538506c4ea8 with scrape type 2
2026-03-27 20:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0da459fb-92dd-57a3-9dc3-c538506c4ea8, identifier: YN67239
2026-03-27 20:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0da459fb-92dd-57a3-9dc3-c538506c4ea8 with identifier: YN67239
2026-03-27 20:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0da459fb-92dd-57a3-9dc3-c538506c4ea8 with identifier: YN67239
2026-03-27 20:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0da459fb-92dd-57a3-9dc3-c538506c4ea8 with identifier: YN67239 to the API
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:16:07Z',
 'fuel_type': 'diesel',
 'id': '0da459fb-92dd-57a3-9dc3-c538506c4ea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN67239',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 187971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-25',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper SD',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN67239%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Saving data for YN67239: {'auction_closing_time': 1774714567.0, 'created_time': 1774438569.83606, 'last_price_update_time': 1774643827.025194}
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN67239') HTTP/1.1" 204 0
2026-03-27 20:37:07 [scrapy.extensions.logstats] INFO: Crawled 69 pages (at 31 pages/min), scraped 105 items (at 55 items/min)
2026-03-27 20:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 168MiB
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for ZF78419: 1
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW46644%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for RW46644: 0
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for KM67426: 2
2026-03-27 20:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-27 20:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c808e87-a02e-5910-b6c8-b37c9cf35179 with scrape type 2
2026-03-27 20:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c808e87-a02e-5910-b6c8-b37c9cf35179 with scrape type 2
2026-03-27 20:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c808e87-a02e-5910-b6c8-b37c9cf35179, identifier: KM67426
2026-03-27 20:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV01738/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-27 20:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426
2026-03-27 20:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c808e87-a02e-5910-b6c8-b37c9cf35179 with identifier: KM67426 to the API
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:21:56Z',
 'fuel_type': 'diesel',
 'id': '3c808e87-a02e-5910-b6c8-b37c9cf35179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM67426',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 162410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-09',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2017}
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Saving data for KM67426: {'auction_closing_time': 1774714916.0, 'created_time': 1774557334.218393, 'last_price_update_time': 1774643827.526821}
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM67426') HTTP/1.1" 204 0
2026-03-27 20:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-27 20:37:07 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS55716%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for HS55716: 1
2026-03-27 20:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for MJ01257: 0
2026-03-27 20:37:07 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB82847%27 HTTP/1.1" 200 None
2026-03-27 20:37:07 [auto1.be] INFO: Scrape type for UB82847: 2
2026-03-27 20:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4718d42e-a060-505b-a2b8-7fe27143762b with identifier: UB82847
2026-03-27 20:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4718d42e-a060-505b-a2b8-7fe27143762b with scrape type 2
2026-03-27 20:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4718d42e-a060-505b-a2b8-7fe27143762b with scrape type 2
2026-03-27 20:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4718d42e-a060-505b-a2b8-7fe27143762b, identifier: UB82847
2026-03-27 20:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4718d42e-a060-505b-a2b8-7fe27143762b with identifier: UB82847
2026-03-27 20:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4718d42e-a060-505b-a2b8-7fe27143762b with identifier: UB82847
2026-03-27 20:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4718d42e-a060-505b-a2b8-7fe27143762b with identifier: UB82847 to the API
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:04:45Z',
 'fuel_type': 'petrol',
 'id': '4718d42e-a060-505b-a2b8-7fe27143762b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB82847',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 118283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Audi A5 Sportback 45 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB82847%27 HTTP/1.1" 200 None
2026-03-27 20:37:08 [auto1.be] INFO: Saving data for UB82847: {'auction_closing_time': 1774713885.0, 'created_time': 1774384668.477982, 'last_price_update_time': 1774643828.094113}
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB82847') HTTP/1.1" 204 0
2026-03-27 20:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR21590%27 HTTP/1.1" 200 None
2026-03-27 20:37:08 [auto1.be] INFO: Scrape type for HR21590: 2
2026-03-27 20:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3831539-78bf-5162-8df7-a7eef201a581 with identifier: HR21590
2026-03-27 20:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3831539-78bf-5162-8df7-a7eef201a581 with scrape type 2
2026-03-27 20:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3831539-78bf-5162-8df7-a7eef201a581 with scrape type 2
2026-03-27 20:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3831539-78bf-5162-8df7-a7eef201a581, identifier: HR21590
2026-03-27 20:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3831539-78bf-5162-8df7-a7eef201a581 with identifier: HR21590
2026-03-27 20:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3831539-78bf-5162-8df7-a7eef201a581 with identifier: HR21590
2026-03-27 20:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3831539-78bf-5162-8df7-a7eef201a581 with identifier: HR21590 to the API
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:09Z',
 'fuel_type': 'diesel',
 'id': 'e3831539-78bf-5162-8df7-a7eef201a581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR21590',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 186992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-19',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2015}
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR21590%27 HTTP/1.1" 200 None
2026-03-27 20:37:08 [auto1.be] INFO: Saving data for HR21590: {'auction_closing_time': 1774715589.0, 'created_time': 1773301664.762086, 'last_price_update_time': 1774643828.472442}
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HR21590') HTTP/1.1" 204 0
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE31569%27 HTTP/1.1" 200 None
2026-03-27 20:37:08 [auto1.be] INFO: Scrape type for NE31569: 1
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-27 20:37:08 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF25932%27 HTTP/1.1" 200 None
2026-03-27 20:37:08 [auto1.be] INFO: Scrape type for TF25932: 2
2026-03-27 20:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca286a0-f162-5a2a-bfb3-afff5b68e8a0 with identifier: TF25932
2026-03-27 20:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca286a0-f162-5a2a-bfb3-afff5b68e8a0 with scrape type 2
2026-03-27 20:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ca286a0-f162-5a2a-bfb3-afff5b68e8a0 with scrape type 2
2026-03-27 20:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9ca286a0-f162-5a2a-bfb3-afff5b68e8a0, identifier: TF25932
2026-03-27 20:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB02189> (referer: https://www.auto1.com/v1/car-details-view/CB02189/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9ca286a0-f162-5a2a-bfb3-afff5b68e8a0 with identifier: TF25932
2026-03-27 20:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9ca286a0-f162-5a2a-bfb3-afff5b68e8a0 with identifier: TF25932
2026-03-27 20:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9ca286a0-f162-5a2a-bfb3-afff5b68e8a0 with identifier: TF25932 to the API
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:09:40Z',
 'fuel_type': 'diesel',
 'id': '9ca286a0-f162-5a2a-bfb3-afff5b68e8a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF25932',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 299306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-09',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.6 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2014}
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF25932%27 HTTP/1.1" 200 None
2026-03-27 20:37:08 [auto1.be] INFO: Saving data for TF25932: {'auction_closing_time': 1774714180.0, 'created_time': 1773240338.087851, 'last_price_update_time': 1774643828.988218}
2026-03-27 20:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF25932') HTTP/1.1" 204 0
2026-03-27 20:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:09 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD17756%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [auto1.be] INFO: Scrape type for BD17756: 2
2026-03-27 20:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3f524b-aa1a-5db6-a5f1-5bb3d83e6690 with identifier: BD17756
2026-03-27 20:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3f524b-aa1a-5db6-a5f1-5bb3d83e6690 with scrape type 2
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3f524b-aa1a-5db6-a5f1-5bb3d83e6690 with scrape type 2
2026-03-27 20:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: be3f524b-aa1a-5db6-a5f1-5bb3d83e6690, identifier: BD17756
2026-03-27 20:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: be3f524b-aa1a-5db6-a5f1-5bb3d83e6690 with identifier: BD17756
2026-03-27 20:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: be3f524b-aa1a-5db6-a5f1-5bb3d83e6690 with identifier: BD17756
2026-03-27 20:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: be3f524b-aa1a-5db6-a5f1-5bb3d83e6690 with identifier: BD17756 to the API
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:37:11Z',
 'fuel_type': 'diesel',
 'id': 'be3f524b-aa1a-5db6-a5f1-5bb3d83e6690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD17756',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 182870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Style 4WD',
 'transmission': 'automatic',
 'trim': 'Style 4WD',
 'year': 2018}
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD17756%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [auto1.be] INFO: Saving data for BD17756: {'auction_closing_time': 1774715831.0, 'created_time': 1774384674.973453, 'last_price_update_time': 1774643829.39375}
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD17756') HTTP/1.1" 204 0
2026-03-27 20:37:09 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-27 20:37:09 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-27 20:37:09 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [auto1.be] INFO: Scrape type for XK75143: 2
2026-03-27 20:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-27 20:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with scrape type 2
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with scrape type 2
2026-03-27 20:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388, identifier: XK75143
2026-03-27 20:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE27589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ08217> (referer: https://www.auto1.com/v1/car-details-view/VZ08217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-27 20:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143
2026-03-27 20:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 832bc6d3-5079-526e-a8b2-7c0cf7ea5388 with identifier: XK75143 to the API
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:40:12Z',
 'fuel_type': 'diesel',
 'id': '832bc6d3-5079-526e-a8b2-7c0cf7ea5388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK75143',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 56193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Express Maxi',
 'transmission': 'manual',
 'trim': 'Express Maxi',
 'year': 2019}
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [auto1.be] INFO: Saving data for XK75143: {'auction_closing_time': 1774716012.0, 'created_time': 1774557325.150018, 'last_price_update_time': 1774643829.801019}
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK75143') HTTP/1.1" 204 0
2026-03-27 20:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b14068e-b00b-5401-b183-2c00ee570b99 with identifier: CB02189
2026-03-27 20:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b14068e-b00b-5401-b183-2c00ee570b99 with scrape type 1
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b14068e-b00b-5401-b183-2c00ee570b99
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_b19bba18aa4778d7c37d53dcfe42491b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_b19bba18aa4778d7c37d53dcfe42491b.jpg already downloaded
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_dc5e1eb2682bc0b1ee42a643a339569a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_dc5e1eb2682bc0b1ee42a643a339569a.jpg already downloaded
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_e39e660387d5edb8d42e53faaade786e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_e39e660387d5edb8d42e53faaade786e.jpg already downloaded
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_1a3356987d86b8b2df757479c9440989.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_1a3356987d86b8b2df757479c9440989.jpg already downloaded
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_5c6cc9c127697b45a841dea6e72a7e41.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_5c6cc9c127697b45a841dea6e72a7e41.jpg already downloaded
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_7a2eea98f9521258a947ba052b10969c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_7a2eea98f9521258a947ba052b10969c.jpg already downloaded
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_0c5f241d6d39f6210ba40616586e81a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_0c5f241d6d39f6210ba40616586e81a7.jpg already downloaded
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_4027a5cb6e283a823ac95b59819686b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_4027a5cb6e283a823ac95b59819686b6.jpg already downloaded
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_1117ec26e337843ec14fa6e2895331b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_1117ec26e337843ec14fa6e2895331b8.jpg already downloaded
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fbc%252F16bc21de3e5266b2326d2ffdb78eb186%252Fpa%252FCB02189_3cbdd22db4dbf615828d0df0d30a1d1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_3cbdd22db4dbf615828d0df0d30a1d1c.jpg already downloaded
2026-03-27 20:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b14068e-b00b-5401-b183-2c00ee570b99, identifier: CB02189
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT96819%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for WT96819: 0
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE05105%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for GE05105: 0
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM85548%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for XM85548: 0
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for YN92139: 0
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP73132%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for EP73132: 0
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH22912%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for LH22912: 0
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK21410%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for YK21410: 1
2026-03-27 20:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b14068e-b00b-5401-b183-2c00ee570b99 with identifier: CB02189
2026-03-27 20:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b14068e-b00b-5401-b183-2c00ee570b99 with identifier: CB02189
2026-03-27 20:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b14068e-b00b-5401-b183-2c00ee570b99 with identifier: CB02189 to the API
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB02189>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:13Z',
 'fuel_type': 'petrol',
 'id': '9b14068e-b00b-5401-b183-2c00ee570b99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB02189',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 113113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_b19bba18aa4778d7c37d53dcfe42491b.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_dc5e1eb2682bc0b1ee42a643a339569a.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_e39e660387d5edb8d42e53faaade786e.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_1a3356987d86b8b2df757479c9440989.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_5c6cc9c127697b45a841dea6e72a7e41.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_7a2eea98f9521258a947ba052b10969c.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_0c5f241d6d39f6210ba40616586e81a7.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_4027a5cb6e283a823ac95b59819686b6.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_1117ec26e337843ec14fa6e2895331b8.jpg',
                'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_3cbdd22db4dbf615828d0df0d30a1d1c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_b19bba18aa4778d7c37d53dcfe42491b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_dc5e1eb2682bc0b1ee42a643a339569a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_e39e660387d5edb8d42e53faaade786e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_1a3356987d86b8b2df757479c9440989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_5c6cc9c127697b45a841dea6e72a7e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_7a2eea98f9521258a947ba052b10969c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_0c5f241d6d39f6210ba40616586e81a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_4027a5cb6e283a823ac95b59819686b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_1117ec26e337843ec14fa6e2895331b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b14068e-b00b-5401-b183-2c00ee570b99/9b14068e-b00b-5401-b183-2c00ee570b99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/bc/16bc21de3e5266b2326d2ffdb78eb186/pa/CB02189_3cbdd22db4dbf615828d0df0d30a1d1c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB02189%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Saving data for CB02189: {'created_time': 1774643830.609042, 'last_price_update_time': 1774643830.609052, 'auction_closing_time': 1774716073.0}
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB02189') HTTP/1.1" 204 0
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-27 20:37:10 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN48415%27 HTTP/1.1" 200 None
2026-03-27 20:37:10 [auto1.be] INFO: Scrape type for HN48415: 2
2026-03-27 20:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ba944c-1e4c-5117-9853-f91c37f21a2a with identifier: HN48415
2026-03-27 20:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ba944c-1e4c-5117-9853-f91c37f21a2a with scrape type 2
2026-03-27 20:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7ba944c-1e4c-5117-9853-f91c37f21a2a with scrape type 2
2026-03-27 20:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7ba944c-1e4c-5117-9853-f91c37f21a2a, identifier: HN48415
2026-03-27 20:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF78419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV01738> (referer: https://www.auto1.com/v1/car-details-view/KV01738/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7ba944c-1e4c-5117-9853-f91c37f21a2a with identifier: HN48415
2026-03-27 20:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7ba944c-1e4c-5117-9853-f91c37f21a2a with identifier: HN48415
2026-03-27 20:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7ba944c-1e4c-5117-9853-f91c37f21a2a with identifier: HN48415 to the API
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:57:02Z',
 'fuel_type': 'diesel',
 'id': 'f7ba944c-1e4c-5117-9853-f91c37f21a2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN48415',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 141063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN48415%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [auto1.be] INFO: Saving data for HN48415: {'auction_closing_time': 1774717022.0, 'created_time': 1774438523.302432, 'last_price_update_time': 1774643831.081528}
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HN48415') HTTP/1.1" 204 0
2026-03-27 20:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS55716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-27 20:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with scrape type 1
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_047468584447ddd275f0980d3550c298.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_047468584447ddd275f0980d3550c298.jpg not downloaded yet
2026-03-27 20:37:11 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-27 20:37:11 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX75796%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [auto1.be] INFO: Scrape type for ZX75796: 2
2026-03-27 20:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2357beaf-d174-5320-8444-66d69491a214 with identifier: ZX75796
2026-03-27 20:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2357beaf-d174-5320-8444-66d69491a214 with scrape type 2
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2357beaf-d174-5320-8444-66d69491a214 with scrape type 2
2026-03-27 20:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2357beaf-d174-5320-8444-66d69491a214, identifier: ZX75796
2026-03-27 20:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2357beaf-d174-5320-8444-66d69491a214 with identifier: ZX75796
2026-03-27 20:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2357beaf-d174-5320-8444-66d69491a214 with identifier: ZX75796
2026-03-27 20:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2357beaf-d174-5320-8444-66d69491a214 with identifier: ZX75796 to the API
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:42:33Z',
 'fuel_type': 'diesel',
 'id': '2357beaf-d174-5320-8444-66d69491a214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX75796',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 247963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-09',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX75796%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [auto1.be] INFO: Saving data for ZX75796: {'auction_closing_time': 1774716153.0, 'created_time': 1774438524.045517, 'last_price_update_time': 1774643831.666929}
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX75796') HTTP/1.1" 204 0
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_798ecfa3010cf5b517f82c68b3691ed7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_798ecfa3010cf5b517f82c68b3691ed7.jpg not downloaded yet
2026-03-27 20:37:11 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN00182%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [auto1.be] INFO: Scrape type for WN00182: 0
2026-03-27 20:37:11 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-27 20:37:11 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-27 20:37:11 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-27 20:37:11 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [auto1.be] INFO: Scrape type for RS16623: 0
2026-03-27 20:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:11 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-27 20:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b819f3-ff35-5688-95c2-36f44ab7e59e with scrape type 1
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70b819f3-ff35-5688-95c2-36f44ab7e59e
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_7947125fbb1d4ab48580a5212db16d50.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_7947125fbb1d4ab48580a5212db16d50.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_484d5ea6ea8f3655ee5c48d7881893fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_484d5ea6ea8f3655ee5c48d7881893fa.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_e618151d3f9b9ccefd5c0a56b20e4cf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_e618151d3f9b9ccefd5c0a56b20e4cf5.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_cb249604678d293bb277cb0341c4611f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_cb249604678d293bb277cb0341c4611f.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_6d2a1c49224a47c3e19b23743b565868.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_6d2a1c49224a47c3e19b23743b565868.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_ac2f0bd4c9f3e920fbc92c6b22f3c0b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ac2f0bd4c9f3e920fbc92c6b22f3c0b5.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_744c2b7615738306e1af5264d2a2aa1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_744c2b7615738306e1af5264d2a2aa1b.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_52929ebfead921697c81034899018b4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_52929ebfead921697c81034899018b4b.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_ff4ece07c731706ed5a871e060a5fc8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ff4ece07c731706ed5a871e060a5fc8d.jpg already downloaded
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F5c%252F945c840c9305b39ae30e7e45f98d2c44%252Fpa%252FKV01738_ab5a8eb82019584625c9b8a943344378.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ab5a8eb82019584625c9b8a943344378.jpg already downloaded
2026-03-27 20:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70b819f3-ff35-5688-95c2-36f44ab7e59e, identifier: KV01738
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_2e303e4dc1665cb7af20d910ad4e8de9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_2e303e4dc1665cb7af20d910ad4e8de9.jpg not downloaded yet
2026-03-27 20:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-27 20:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738
2026-03-27 20:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70b819f3-ff35-5688-95c2-36f44ab7e59e with identifier: KV01738 to the API
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV01738>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:32:13Z',
 'fuel_type': 'petrol',
 'id': '70b819f3-ff35-5688-95c2-36f44ab7e59e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV01738',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 216617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_7947125fbb1d4ab48580a5212db16d50.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_484d5ea6ea8f3655ee5c48d7881893fa.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_e618151d3f9b9ccefd5c0a56b20e4cf5.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_cb249604678d293bb277cb0341c4611f.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_6d2a1c49224a47c3e19b23743b565868.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ac2f0bd4c9f3e920fbc92c6b22f3c0b5.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_744c2b7615738306e1af5264d2a2aa1b.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_52929ebfead921697c81034899018b4b.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ff4ece07c731706ed5a871e060a5fc8d.jpg',
                'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ab5a8eb82019584625c9b8a943344378.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_7947125fbb1d4ab48580a5212db16d50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_484d5ea6ea8f3655ee5c48d7881893fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_e618151d3f9b9ccefd5c0a56b20e4cf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_cb249604678d293bb277cb0341c4611f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516477,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_6d2a1c49224a47c3e19b23743b565868.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ac2f0bd4c9f3e920fbc92c6b22f3c0b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_744c2b7615738306e1af5264d2a2aa1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2396917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_52929ebfead921697c81034899018b4b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2390387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ff4ece07c731706ed5a871e060a5fc8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b819f3-ff35-5688-95c2-36f44ab7e59e/70b819f3-ff35-5688-95c2-36f44ab7e59e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490671,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/5c/945c840c9305b39ae30e7e45f98d2c44/pa/KV01738_ab5a8eb82019584625c9b8a943344378.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Soleil',
 'transmission': 'manual',
 'trim': 'Soleil',
 'year': 2019}
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [auto1.be] INFO: Saving data for KV01738: {'created_time': 1774643832.341837, 'last_price_update_time': 1774643832.341853, 'auction_closing_time': 1774715533.0}
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV01738') HTTP/1.1" 204 0
2026-03-27 20:37:12 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-27 20:37:12 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF21497%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [auto1.be] INFO: Scrape type for HF21497: 0
2026-03-27 20:37:12 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK03982%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [auto1.be] INFO: Scrape type for CK03982: 2
2026-03-27 20:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4f4eb21-465c-5636-abd6-bc1d00ee20ea with identifier: CK03982
2026-03-27 20:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4f4eb21-465c-5636-abd6-bc1d00ee20ea with scrape type 2
2026-03-27 20:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4f4eb21-465c-5636-abd6-bc1d00ee20ea with scrape type 2
2026-03-27 20:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4f4eb21-465c-5636-abd6-bc1d00ee20ea, identifier: CK03982
2026-03-27 20:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_009a4350f95dc26526923f9e2925753d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_009a4350f95dc26526923f9e2925753d.jpg not downloaded yet
2026-03-27 20:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4f4eb21-465c-5636-abd6-bc1d00ee20ea with identifier: CK03982
2026-03-27 20:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4f4eb21-465c-5636-abd6-bc1d00ee20ea with identifier: CK03982
2026-03-27 20:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4f4eb21-465c-5636-abd6-bc1d00ee20ea with identifier: CK03982 to the API
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:27:02Z',
 'fuel_type': 'diesel',
 'id': 'c4f4eb21-465c-5636-abd6-bc1d00ee20ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK03982',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 164837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-22',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK03982%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [auto1.be] INFO: Saving data for CK03982: {'auction_closing_time': 1774715222.0, 'created_time': 1773239595.354697, 'last_price_update_time': 1774643832.768159}
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK03982') HTTP/1.1" 204 0
2026-03-27 20:37:12 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15441%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [auto1.be] INFO: Scrape type for CH15441: 2
2026-03-27 20:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00f53bdd-beb3-5e09-ab3e-9f1090609548 with identifier: CH15441
2026-03-27 20:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00f53bdd-beb3-5e09-ab3e-9f1090609548 with scrape type 2
2026-03-27 20:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00f53bdd-beb3-5e09-ab3e-9f1090609548 with scrape type 2
2026-03-27 20:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00f53bdd-beb3-5e09-ab3e-9f1090609548, identifier: CH15441
2026-03-27 20:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_047468584447ddd275f0980d3550c298.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_90e37288e509220ae0c07038e5f4ee92.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_90e37288e509220ae0c07038e5f4ee92.jpg not downloaded yet
2026-03-27 20:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00f53bdd-beb3-5e09-ab3e-9f1090609548 with identifier: CH15441
2026-03-27 20:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00f53bdd-beb3-5e09-ab3e-9f1090609548 with identifier: CH15441
2026-03-27 20:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00f53bdd-beb3-5e09-ab3e-9f1090609548 with identifier: CH15441 to the API
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:25:01Z',
 'fuel_type': 'diesel',
 'id': '00f53bdd-beb3-5e09-ab3e-9f1090609548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH15441',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 136902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-23',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2018}
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15441%27 HTTP/1.1" 200 None
2026-03-27 20:37:13 [auto1.be] INFO: Saving data for CH15441: {'auction_closing_time': 1774715101.0, 'created_time': 1774438574.461391, 'last_price_update_time': 1774643833.231212}
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH15441') HTTP/1.1" 204 0
2026-03-27 20:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE31569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_798ecfa3010cf5b517f82c68b3691ed7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:13 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-27 20:37:13 [auto1.be] INFO: Scrape type for LF23330: 2
2026-03-27 20:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-27 20:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 789a9828-d901-5a3c-bfde-13ea36225351 with scrape type 2
2026-03-27 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 789a9828-d901-5a3c-bfde-13ea36225351 with scrape type 2
2026-03-27 20:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 789a9828-d901-5a3c-bfde-13ea36225351, identifier: LF23330
2026-03-27 20:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_2e303e4dc1665cb7af20d910ad4e8de9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_5d1774463b587c7d490b5ad11e671545.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_5d1774463b587c7d490b5ad11e671545.jpg not downloaded yet
2026-03-27 20:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-27 20:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330
2026-03-27 20:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 789a9828-d901-5a3c-bfde-13ea36225351 with identifier: LF23330 to the API
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:09:52Z',
 'fuel_type': 'diesel',
 'id': '789a9828-d901-5a3c-bfde-13ea36225351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF23330',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 220661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-08',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDIe Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-27 20:37:13 [auto1.be] INFO: Saving data for LF23330: {'auction_closing_time': 1774714192.0, 'created_time': 1774557332.108156, 'last_price_update_time': 1774643833.723142}
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF23330') HTTP/1.1" 204 0
2026-03-27 20:37:13 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-27 20:37:13 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-27 20:37:13 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-27 20:37:13 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-27 20:37:13 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-27 20:37:13 [auto1.be] INFO: Scrape type for HM28534: 2
2026-03-27 20:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534
2026-03-27 20:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with scrape type 2
2026-03-27 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with scrape type 2
2026-03-27 20:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12fd8785-a85a-584b-9fa7-755ac0bf3d47, identifier: HM28534
2026-03-27 20:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e1ce50>
2026-03-27 20:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_047468584447ddd275f0980d3550c298.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_047468584447ddd275f0980d3550c298.jpg saved to cache
2026-03-27 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_31e6baae667cf978df3763cc7ff2826c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_31e6baae667cf978df3763cc7ff2826c.jpg not downloaded yet
2026-03-27 20:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534
2026-03-27 20:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534
2026-03-27 20:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534 to the API
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:18:59Z',
 'fuel_type': 'diesel',
 'id': '12fd8785-a85a-584b-9fa7-755ac0bf3d47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM28534',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 39264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-28',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L1 Trend',
 'transmission': 'automatic',
 'trim': '300 L1 Trend',
 'year': 2023}
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [auto1.be] INFO: Saving data for HM28534: {'auction_closing_time': 1774714739.0, 'created_time': 1774384671.874855, 'last_price_update_time': 1774643834.220616}
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM28534') HTTP/1.1" 204 0
2026-03-27 20:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_009a4350f95dc26526923f9e2925753d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG60858%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [auto1.be] INFO: Scrape type for WG60858: 0
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN58260%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [auto1.be] INFO: Scrape type for YN58260: 0
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC53588%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [auto1.be] INFO: Scrape type for ZC53588: 0
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA07784%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [auto1.be] INFO: Scrape type for PA07784: 2
2026-03-27 20:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61c07d49-0895-5800-8df4-67473a140ae4 with identifier: PA07784
2026-03-27 20:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c07d49-0895-5800-8df4-67473a140ae4 with scrape type 2
2026-03-27 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61c07d49-0895-5800-8df4-67473a140ae4 with scrape type 2
2026-03-27 20:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 61c07d49-0895-5800-8df4-67473a140ae4, identifier: PA07784
2026-03-27 20:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK21410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d05710>
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_798ecfa3010cf5b517f82c68b3691ed7.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_798ecfa3010cf5b517f82c68b3691ed7.jpg saved to cache
2026-03-27 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f88b50>
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_2e303e4dc1665cb7af20d910ad4e8de9.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_2e303e4dc1665cb7af20d910ad4e8de9.jpg saved to cache
2026-03-27 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_90e37288e509220ae0c07038e5f4ee92.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_b4d05c758fd22c32be4de5131f2ff59e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_b4d05c758fd22c32be4de5131f2ff59e.jpg not downloaded yet
2026-03-27 20:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 61c07d49-0895-5800-8df4-67473a140ae4 with identifier: PA07784
2026-03-27 20:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 61c07d49-0895-5800-8df4-67473a140ae4 with identifier: PA07784
2026-03-27 20:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 61c07d49-0895-5800-8df4-67473a140ae4 with identifier: PA07784 to the API
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:07:08Z',
 'fuel_type': 'diesel',
 'id': '61c07d49-0895-5800-8df4-67473a140ae4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA07784',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 246200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA07784%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [auto1.be] INFO: Saving data for PA07784: {'auction_closing_time': 1774714028.0, 'created_time': 1774438583.822028, 'last_price_update_time': 1774643834.792241}
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PA07784') HTTP/1.1" 204 0
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-27 20:37:14 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-27 20:37:14 [auto1.be] INFO: Scrape type for LP97900: 2
2026-03-27 20:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-27 20:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24fb04d-1ea3-5a18-8032-cb7db71dff9a with scrape type 2
2026-03-27 20:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24fb04d-1ea3-5a18-8032-cb7db71dff9a with scrape type 2
2026-03-27 20:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c24fb04d-1ea3-5a18-8032-cb7db71dff9a, identifier: LP97900
2026-03-27 20:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_eb40b623f90d59fa65817aad2239d1bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_eb40b623f90d59fa65817aad2239d1bf.jpg not downloaded yet
2026-03-27 20:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-27 20:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900
2026-03-27 20:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c24fb04d-1ea3-5a18-8032-cb7db71dff9a with identifier: LP97900 to the API
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:08:19Z',
 'fuel_type': 'petrol',
 'id': 'c24fb04d-1ea3-5a18-8032-cb7db71dff9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP97900',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 156187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-11',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Saving data for LP97900: {'auction_closing_time': 1774714099.0, 'created_time': 1774557403.015356, 'last_price_update_time': 1774643835.292858}
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP97900') HTTP/1.1" 204 0
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d79910>
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_009a4350f95dc26526923f9e2925753d.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_009a4350f95dc26526923f9e2925753d.jpg saved to cache
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_5d1774463b587c7d490b5ad11e671545.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL24574%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Scrape type for JL24574: 0
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB18331%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Scrape type for GB18331: 0
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE98600%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Scrape type for GE98600: 2
2026-03-27 20:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30a6b339-df97-5350-9299-2b4370f2fe75 with identifier: GE98600
2026-03-27 20:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a6b339-df97-5350-9299-2b4370f2fe75 with scrape type 2
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30a6b339-df97-5350-9299-2b4370f2fe75 with scrape type 2
2026-03-27 20:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30a6b339-df97-5350-9299-2b4370f2fe75, identifier: GE98600
2026-03-27 20:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE27589> (referer: https://www.auto1.com/v1/car-details-view/HE27589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e9e590>
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_90e37288e509220ae0c07038e5f4ee92.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_90e37288e509220ae0c07038e5f4ee92.jpg saved to cache
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_31e6baae667cf978df3763cc7ff2826c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_67509ba25e25c2e17a87f6ca2dc7a75f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_67509ba25e25c2e17a87f6ca2dc7a75f.jpg not downloaded yet
2026-03-27 20:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30a6b339-df97-5350-9299-2b4370f2fe75 with identifier: GE98600
2026-03-27 20:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30a6b339-df97-5350-9299-2b4370f2fe75 with identifier: GE98600
2026-03-27 20:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30a6b339-df97-5350-9299-2b4370f2fe75 with identifier: GE98600 to the API
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:21Z',
 'fuel_type': 'diesel',
 'id': '30a6b339-df97-5350-9299-2b4370f2fe75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE98600',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 204326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2016}
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE98600%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Saving data for GE98600: {'auction_closing_time': 1774716201.0, 'created_time': 1774438522.4492, 'last_price_update_time': 1774643835.861557}
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GE98600') HTTP/1.1" 204 0
2026-03-27 20:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:15 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM50519%27 HTTP/1.1" 200 None
2026-03-27 20:37:15 [auto1.be] INFO: Scrape type for UM50519: 2
2026-03-27 20:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4e64c45-4c7d-5c98-bba2-2f9b98627119 with identifier: UM50519
2026-03-27 20:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4e64c45-4c7d-5c98-bba2-2f9b98627119 with scrape type 2
2026-03-27 20:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4e64c45-4c7d-5c98-bba2-2f9b98627119 with scrape type 2
2026-03-27 20:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4e64c45-4c7d-5c98-bba2-2f9b98627119, identifier: UM50519
2026-03-27 20:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF78419> (referer: https://www.auto1.com/v1/car-details-view/ZF78419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4e64c45-4c7d-5c98-bba2-2f9b98627119 with identifier: UM50519
2026-03-27 20:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4e64c45-4c7d-5c98-bba2-2f9b98627119 with identifier: UM50519
2026-03-27 20:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4e64c45-4c7d-5c98-bba2-2f9b98627119 with identifier: UM50519 to the API
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:05Z',
 'fuel_type': 'diesel',
 'id': 'c4e64c45-4c7d-5c98-bba2-2f9b98627119',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM50519',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 357326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2009}
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM50519%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [auto1.be] INFO: Saving data for UM50519: {'auction_closing_time': 1774714805.0, 'created_time': 1774438595.338345, 'last_price_update_time': 1774643836.340111}
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM50519') HTTP/1.1" 204 0
2026-03-27 20:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_b4d05c758fd22c32be4de5131f2ff59e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:16 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-27 20:37:16 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-27 20:37:16 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [auto1.be] INFO: Scrape type for KZ95632: 2
2026-03-27 20:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-27 20:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with scrape type 2
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with scrape type 2
2026-03-27 20:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa429584-98dd-52b8-ba87-dfdfb2bd2f40, identifier: KZ95632
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e71f90>
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_5d1774463b587c7d490b5ad11e671545.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_5d1774463b587c7d490b5ad11e671545.jpg saved to cache
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e739106-b95c-5986-9a1a-3cce509c62a0 with identifier: HE27589
2026-03-27 20:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e739106-b95c-5986-9a1a-3cce509c62a0 with scrape type 1
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e739106-b95c-5986-9a1a-3cce509c62a0
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_29893bdb32a5487a4ff91caa23f7accb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_29893bdb32a5487a4ff91caa23f7accb.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_f623f2cc0515845340901096e63cbfb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_f623f2cc0515845340901096e63cbfb5.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_2a5a600cfe0d7c49af75d7b4b4589beb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_2a5a600cfe0d7c49af75d7b4b4589beb.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_7e0a6c7f756c1f0ad264195466a51395.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_7e0a6c7f756c1f0ad264195466a51395.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_ef1855a06ba481afefecadab1cc84bbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_ef1855a06ba481afefecadab1cc84bbd.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_776eda1413abe1f9042bf2e7e997ecc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_776eda1413abe1f9042bf2e7e997ecc2.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_91124dd5102fb267f989ec6ac550653f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_91124dd5102fb267f989ec6ac550653f.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_0eae7dbce4b2a87c6f424ea50030e40f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_0eae7dbce4b2a87c6f424ea50030e40f.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_41a854e762d8f5609a42a58a1db2fad2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_41a854e762d8f5609a42a58a1db2fad2.jpg already downloaded
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Ff7%252F24f70d1e579178ce814f3a36ba24e1a2%252Fpa%252FHE27589_7eb0e192ec39fd9d4b3239df75f997a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_7eb0e192ec39fd9d4b3239df75f997a2.jpg already downloaded
2026-03-27 20:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e739106-b95c-5986-9a1a-3cce509c62a0, identifier: HE27589
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c90150>
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_31e6baae667cf978df3763cc7ff2826c.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_31e6baae667cf978df3763cc7ff2826c.jpg saved to cache
2026-03-27 20:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-27 20:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-27 20:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632 to the API
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:51:28Z',
 'fuel_type': 'petrol',
 'id': 'fa429584-98dd-52b8-ba87-dfdfb2bd2f40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ95632',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 65099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2016}
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [auto1.be] INFO: Saving data for KZ95632: {'auction_closing_time': 1774716688.0, 'created_time': 1774298271.500588, 'last_price_update_time': 1774643837.211871}
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ95632') HTTP/1.1" 204 0
2026-03-27 20:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e739106-b95c-5986-9a1a-3cce509c62a0 with identifier: HE27589
2026-03-27 20:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e739106-b95c-5986-9a1a-3cce509c62a0 with identifier: HE27589
2026-03-27 20:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e739106-b95c-5986-9a1a-3cce509c62a0 with identifier: HE27589 to the API
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE27589>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:46:31Z',
 'fuel_type': 'petrol',
 'id': '6e739106-b95c-5986-9a1a-3cce509c62a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE27589',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 134097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_29893bdb32a5487a4ff91caa23f7accb.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_f623f2cc0515845340901096e63cbfb5.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_2a5a600cfe0d7c49af75d7b4b4589beb.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_7e0a6c7f756c1f0ad264195466a51395.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_ef1855a06ba481afefecadab1cc84bbd.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_776eda1413abe1f9042bf2e7e997ecc2.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_91124dd5102fb267f989ec6ac550653f.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_0eae7dbce4b2a87c6f424ea50030e40f.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_41a854e762d8f5609a42a58a1db2fad2.jpg',
                'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_7eb0e192ec39fd9d4b3239df75f997a2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_29893bdb32a5487a4ff91caa23f7accb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_f623f2cc0515845340901096e63cbfb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_2a5a600cfe0d7c49af75d7b4b4589beb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_7e0a6c7f756c1f0ad264195466a51395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_ef1855a06ba481afefecadab1cc84bbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_776eda1413abe1f9042bf2e7e997ecc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_91124dd5102fb267f989ec6ac550653f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_0eae7dbce4b2a87c6f424ea50030e40f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_41a854e762d8f5609a42a58a1db2fad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e739106-b95c-5986-9a1a-3cce509c62a0/6e739106-b95c-5986-9a1a-3cce509c62a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f70d1e579178ce814f3a36ba24e1a2/pa/HE27589_7eb0e192ec39fd9d4b3239df75f997a2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2018}
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE27589%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [auto1.be] INFO: Saving data for HE27589: {'created_time': 1774643837.537435, 'last_price_update_time': 1774643837.537448, 'auction_closing_time': 1774716391.0}
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE27589') HTTP/1.1" 204 0
2026-03-27 20:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_eb40b623f90d59fa65817aad2239d1bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:17 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-27 20:37:17 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [auto1.be] INFO: Scrape type for RR05667: 2
2026-03-27 20:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-27 20:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf95bcee-79ec-58ca-95a9-5c510f677def with scrape type 2
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf95bcee-79ec-58ca-95a9-5c510f677def with scrape type 2
2026-03-27 20:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf95bcee-79ec-58ca-95a9-5c510f677def, identifier: RR05667
2026-03-27 20:37:17 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-27 20:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with scrape type 1
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F9f%252F3c9f0c7c0c27bd52936fdd144e9a4aff%252Fpa%252FZF78419_7a0916c97548f59a8b9c2047afa4f89f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_7a0916c97548f59a8b9c2047afa4f89f.jpg already downloaded
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F9f%252F3c9f0c7c0c27bd52936fdd144e9a4aff%252Fpa%252FZF78419_1f80abd792fb8910a3b3076058c39e6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_1f80abd792fb8910a3b3076058c39e6b.jpg already downloaded
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F9f%252F3c9f0c7c0c27bd52936fdd144e9a4aff%252Fpa%252FZF78419_76065f95d38f8afb0438cb5cc44e84a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_76065f95d38f8afb0438cb5cc44e84a6.jpg already downloaded
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F9f%252F3c9f0c7c0c27bd52936fdd144e9a4aff%252Fpa%252FZF78419_554de8cee0f07026af87b60ef95f5860.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_554de8cee0f07026af87b60ef95f5860.jpg already downloaded
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F9f%252F3c9f0c7c0c27bd52936fdd144e9a4aff%252Fpa%252FZF78419_77ca22996fbbfff2ffce6233ad42ff2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_77ca22996fbbfff2ffce6233ad42ff2c.jpg already downloaded
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F9f%252F3c9f0c7c0c27bd52936fdd144e9a4aff%252Fpa%252FZF78419_2b855dad8a70a8ab139c7d6582e8ae3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_2b855dad8a70a8ab139c7d6582e8ae3f.jpg already downloaded
2026-03-27 20:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f, identifier: ZF78419
2026-03-27 20:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_67509ba25e25c2e17a87f6ca2dc7a75f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-27 20:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-27 20:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667 to the API
2026-03-27 20:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:47:27Z',
 'fuel_type': 'petrol',
 'id': 'cf95bcee-79ec-58ca-95a9-5c510f677def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR05667',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 62351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion',
 'year': 2018}
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-27 20:37:18 [auto1.be] INFO: Saving data for RR05667: {'auction_closing_time': 1774716447.0, 'created_time': 1774471142.833519, 'last_price_update_time': 1774643838.139256}
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR05667') HTTP/1.1" 204 0
2026-03-27 20:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-27 20:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419
2026-03-27 20:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f with identifier: ZF78419 to the API
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF78419>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:23:06Z',
 'fuel_type': 'diesel',
 'id': '10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF78419',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 190486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_7a0916c97548f59a8b9c2047afa4f89f.jpg',
                'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_1f80abd792fb8910a3b3076058c39e6b.jpg',
                'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_76065f95d38f8afb0438cb5cc44e84a6.jpg',
                'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_554de8cee0f07026af87b60ef95f5860.jpg',
                'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_77ca22996fbbfff2ffce6233ad42ff2c.jpg',
                'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_2b855dad8a70a8ab139c7d6582e8ae3f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f/10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_7a0916c97548f59a8b9c2047afa4f89f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f/10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_1f80abd792fb8910a3b3076058c39e6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f/10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_76065f95d38f8afb0438cb5cc44e84a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f/10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_554de8cee0f07026af87b60ef95f5860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f/10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_77ca22996fbbfff2ffce6233ad42ff2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f/10baaa8d-9b2c-5bb3-ad62-e8608cfbb57f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/9f/3c9f0c7c0c27bd52936fdd144e9a4aff/pa/ZF78419_2b855dad8a70a8ab139c7d6582e8ae3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TDI Greenline',
 'transmission': 'manual',
 'trim': 'Greenline',
 'year': 2011}
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-27 20:37:18 [auto1.be] INFO: Saving data for ZF78419: {'created_time': 1774643838.420648, 'last_price_update_time': 1774643838.420661, 'auction_closing_time': 1774714986.0}
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF78419') HTTP/1.1" 204 0
2026-03-27 20:37:18 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-27 20:37:18 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-27 20:37:18 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-27 20:37:18 [auto1.be] INFO: Scrape type for HX42019: 1
2026-03-27 20:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS55716> (referer: https://www.auto1.com/v1/car-details-view/HS55716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9120fd790>
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_b4d05c758fd22c32be4de5131f2ff59e.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_b4d05c758fd22c32be4de5131f2ff59e.jpg saved to cache
2026-03-27 20:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:18 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-27 20:37:18 [auto1.be] INFO: Scrape type for VB51630: 2
2026-03-27 20:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-27 20:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a778dadb-4594-5ba8-adfe-51f7584663f1 with scrape type 2
2026-03-27 20:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a778dadb-4594-5ba8-adfe-51f7584663f1 with scrape type 2
2026-03-27 20:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a778dadb-4594-5ba8-adfe-51f7584663f1, identifier: VB51630
2026-03-27 20:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE31569> (referer: https://www.auto1.com/v1/car-details-view/NE31569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-27 20:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-27 20:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630 to the API
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:45:00Z',
 'fuel_type': 'diesel',
 'id': 'a778dadb-4594-5ba8-adfe-51f7584663f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB51630',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 324983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Style+',
 'transmission': 'manual',
 'trim': 'Style+',
 'year': 2010}
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-27 20:37:18 [auto1.be] INFO: Saving data for VB51630: {'auction_closing_time': 1774716300.0, 'created_time': 1774125497.948713, 'last_price_update_time': 1774643838.897912}
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB51630') HTTP/1.1" 204 0
2026-03-27 20:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c7d110>
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_eb40b623f90d59fa65817aad2239d1bf.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_eb40b623f90d59fa65817aad2239d1bf.jpg saved to cache
2026-03-27 20:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eac9d0>
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F86%252F33869da9ad4d6074ed104c7f10661e0e%252Fpa%252FVZ08217_67509ba25e25c2e17a87f6ca2dc7a75f.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_67509ba25e25c2e17a87f6ca2dc7a75f.jpg saved to cache
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f
2026-03-27 20:37:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f, skipping ID generation
2026-03-27 20:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with scrape type 1
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3637e5af-02b9-5d3e-84f7-3dfaf610a57f sending to next pipeline
2026-03-27 20:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f, identifier: VZ08217
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [auto1.be] INFO: Scrape type for TS78695: 0
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL98118%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [auto1.be] INFO: Scrape type for UL98118: 1
2026-03-27 20:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-27 20:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217
2026-03-27 20:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3637e5af-02b9-5d3e-84f7-3dfaf610a57f with identifier: VZ08217 to the API
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_67509ba25e25c2e17a87f6ca2dc7a75f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:15:23Z',
 'fuel_type': 'diesel',
 'id': '3637e5af-02b9-5d3e-84f7-3dfaf610a57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ08217',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 117666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_047468584447ddd275f0980d3550c298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_798ecfa3010cf5b517f82c68b3691ed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_2e303e4dc1665cb7af20d910ad4e8de9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_009a4350f95dc26526923f9e2925753d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_90e37288e509220ae0c07038e5f4ee92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_5d1774463b587c7d490b5ad11e671545.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_31e6baae667cf978df3763cc7ff2826c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_b4d05c758fd22c32be4de5131f2ff59e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_eb40b623f90d59fa65817aad2239d1bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3637e5af-02b9-5d3e-84f7-3dfaf610a57f/3637e5af-02b9-5d3e-84f7-3dfaf610a57f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/86/33869da9ad4d6074ed104c7f10661e0e/pa/VZ08217_67509ba25e25c2e17a87f6ca2dc7a75f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [auto1.be] INFO: Saving data for VZ08217: {'created_time': 1774643839.440556, 'last_price_update_time': 1774643839.44057, 'auction_closing_time': 1774714523.0}
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ08217') HTTP/1.1" 204 0
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [auto1.be] INFO: Scrape type for AY48728: 0
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW49487%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [auto1.be] INFO: Scrape type for KW49487: 0
2026-03-27 20:37:19 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [auto1.be] INFO: Scrape type for YU69949: 1
2026-03-27 20:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399d33fd-66fd-5ea1-814d-cdfb198a9a41 with identifier: HS55716
2026-03-27 20:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399d33fd-66fd-5ea1-814d-cdfb198a9a41 with scrape type 1
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 399d33fd-66fd-5ea1-814d-cdfb198a9a41
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_7388dfc38eb2d2657354dd31b02feb13.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_7388dfc38eb2d2657354dd31b02feb13.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_2ab5309c6289c3f9fa5dbd18f9eb2fb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_2ab5309c6289c3f9fa5dbd18f9eb2fb1.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_5e2339d2a9dca0a4ab5dde5bc63fd653.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_5e2339d2a9dca0a4ab5dde5bc63fd653.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_d120a49eddb974b3a3725818ac88a585.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_d120a49eddb974b3a3725818ac88a585.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_dbf9d39fe76027b444f66929220ac34b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_dbf9d39fe76027b444f66929220ac34b.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_ad0bdd8440f41a95bf7db20a7191333d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_ad0bdd8440f41a95bf7db20a7191333d.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_b4944a6272a593302a79c1233ddb3546.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_b4944a6272a593302a79c1233ddb3546.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_f75d1f4d8351ee062afc1ad80e097557.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_f75d1f4d8351ee062afc1ad80e097557.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_455e0c32d1e0d67898ed2df3647061b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_455e0c32d1e0d67898ed2df3647061b1.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fb6%252Feab6841fa94eade3da1b8079e6feffc0%252Fpa%252FHS55716_3ffe6e9926ef468d0a55008bd351f5fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_3ffe6e9926ef468d0a55008bd351f5fb.jpg already downloaded
2026-03-27 20:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 399d33fd-66fd-5ea1-814d-cdfb198a9a41, identifier: HS55716
2026-03-27 20:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80af17bd-3c6a-513b-8380-2e6298a302b6 with identifier: NE31569
2026-03-27 20:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80af17bd-3c6a-513b-8380-2e6298a302b6 with scrape type 1
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80af17bd-3c6a-513b-8380-2e6298a302b6
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_63d9a64d55b1e1c5432763ada5303dad.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_63d9a64d55b1e1c5432763ada5303dad.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_530bb8b82d5fa40f5cb459bc3900464d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_530bb8b82d5fa40f5cb459bc3900464d.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_ab5bb62ce87730b98e4839bc550ceaa9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_ab5bb62ce87730b98e4839bc550ceaa9.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_a78bca1e925944411e458f137840923b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_a78bca1e925944411e458f137840923b.jpg already downloaded
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_9f7e5b22a7d32a7a271c2e24bb8bd8d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_9f7e5b22a7d32a7a271c2e24bb8bd8d7.jpg already downloaded
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_d79dbd6f570278735c761c9a089ff339.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_d79dbd6f570278735c761c9a089ff339.jpg already downloaded
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_62a085c957a3f0427a23ccdf66b6a3de.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_62a085c957a3f0427a23ccdf66b6a3de.jpg already downloaded
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_0eb89ccd51c8e6b95808f0e98ad03130.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_0eb89ccd51c8e6b95808f0e98ad03130.jpg already downloaded
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_eafda03beb7c5de2a3441837477fe1bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_eafda03beb7c5de2a3441837477fe1bc.jpg already downloaded
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F72%252F6272515482da5ae753162d92f495e996%252Fpa%252FNE31569_16c38613386f017fc8036e022bb30247.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_16c38613386f017fc8036e022bb30247.jpg already downloaded
2026-03-27 20:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80af17bd-3c6a-513b-8380-2e6298a302b6, identifier: NE31569
2026-03-27 20:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 399d33fd-66fd-5ea1-814d-cdfb198a9a41 with identifier: HS55716
2026-03-27 20:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 399d33fd-66fd-5ea1-814d-cdfb198a9a41 with identifier: HS55716
2026-03-27 20:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 399d33fd-66fd-5ea1-814d-cdfb198a9a41 with identifier: HS55716 to the API
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HS55716>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:25Z',
 'fuel_type': 'petrol',
 'id': '399d33fd-66fd-5ea1-814d-cdfb198a9a41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS55716',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 114802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_7388dfc38eb2d2657354dd31b02feb13.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_2ab5309c6289c3f9fa5dbd18f9eb2fb1.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_5e2339d2a9dca0a4ab5dde5bc63fd653.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_d120a49eddb974b3a3725818ac88a585.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_dbf9d39fe76027b444f66929220ac34b.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_ad0bdd8440f41a95bf7db20a7191333d.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_b4944a6272a593302a79c1233ddb3546.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_f75d1f4d8351ee062afc1ad80e097557.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_455e0c32d1e0d67898ed2df3647061b1.jpg',
                'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_3ffe6e9926ef468d0a55008bd351f5fb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_7388dfc38eb2d2657354dd31b02feb13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_2ab5309c6289c3f9fa5dbd18f9eb2fb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_5e2339d2a9dca0a4ab5dde5bc63fd653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_d120a49eddb974b3a3725818ac88a585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_dbf9d39fe76027b444f66929220ac34b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_ad0bdd8440f41a95bf7db20a7191333d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_b4944a6272a593302a79c1233ddb3546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_f75d1f4d8351ee062afc1ad80e097557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_455e0c32d1e0d67898ed2df3647061b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_399d33fd-66fd-5ea1-814d-cdfb198a9a41/399d33fd-66fd-5ea1-814d-cdfb198a9a41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/b6/eab6841fa94eade3da1b8079e6feffc0/pa/HS55716_3ffe6e9926ef468d0a55008bd351f5fb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2018}
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS55716%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [auto1.be] INFO: Saving data for HS55716: {'created_time': 1774643840.447643, 'last_price_update_time': 1774643840.447655, 'auction_closing_time': 1774716025.0}
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS55716') HTTP/1.1" 204 0
2026-03-27 20:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80af17bd-3c6a-513b-8380-2e6298a302b6 with identifier: NE31569
2026-03-27 20:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80af17bd-3c6a-513b-8380-2e6298a302b6 with identifier: NE31569
2026-03-27 20:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80af17bd-3c6a-513b-8380-2e6298a302b6 with identifier: NE31569 to the API
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE31569>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:59:11Z',
 'fuel_type': 'diesel',
 'id': '80af17bd-3c6a-513b-8380-2e6298a302b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE31569',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'BMW',
 'model': '1er',
 'odometer': 153878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_63d9a64d55b1e1c5432763ada5303dad.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_530bb8b82d5fa40f5cb459bc3900464d.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_ab5bb62ce87730b98e4839bc550ceaa9.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_a78bca1e925944411e458f137840923b.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_9f7e5b22a7d32a7a271c2e24bb8bd8d7.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_d79dbd6f570278735c761c9a089ff339.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_62a085c957a3f0427a23ccdf66b6a3de.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_0eb89ccd51c8e6b95808f0e98ad03130.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_eafda03beb7c5de2a3441837477fe1bc.jpg',
                'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_16c38613386f017fc8036e022bb30247.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_63d9a64d55b1e1c5432763ada5303dad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_530bb8b82d5fa40f5cb459bc3900464d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_ab5bb62ce87730b98e4839bc550ceaa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_a78bca1e925944411e458f137840923b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_9f7e5b22a7d32a7a271c2e24bb8bd8d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_d79dbd6f570278735c761c9a089ff339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_62a085c957a3f0427a23ccdf66b6a3de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_0eb89ccd51c8e6b95808f0e98ad03130.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_eafda03beb7c5de2a3441837477fe1bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80af17bd-3c6a-513b-8380-2e6298a302b6/80af17bd-3c6a-513b-8380-2e6298a302b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/72/6272515482da5ae753162d92f495e996/pa/NE31569_16c38613386f017fc8036e022bb30247.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Advantage',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Advantage',
 'year': 2017}
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE31569%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [auto1.be] INFO: Saving data for NE31569: {'created_time': 1774643840.824363, 'last_price_update_time': 1774643840.824375, 'auction_closing_time': 1774717151.0}
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NE31569') HTTP/1.1" 204 0
2026-03-27 20:37:20 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [auto1.be] INFO: Scrape type for JC58807: 0
2026-03-27 20:37:20 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA01247%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [auto1.be] INFO: Scrape type for PA01247: 1
2026-03-27 20:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK21410> (referer: https://www.auto1.com/v1/car-details-view/YK21410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:20 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-27 20:37:20 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-27 20:37:20 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-27 20:37:20 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV96305%27 HTTP/1.1" 200 None
2026-03-27 20:37:20 [auto1.be] INFO: Scrape type for NV96305: 2
2026-03-27 20:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69ea11c-b0a1-524f-8a2c-34c4880a3d2c with identifier: NV96305
2026-03-27 20:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69ea11c-b0a1-524f-8a2c-34c4880a3d2c with scrape type 2
2026-03-27 20:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69ea11c-b0a1-524f-8a2c-34c4880a3d2c with scrape type 2
2026-03-27 20:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c69ea11c-b0a1-524f-8a2c-34c4880a3d2c, identifier: NV96305
2026-03-27 20:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c69ea11c-b0a1-524f-8a2c-34c4880a3d2c with identifier: NV96305
2026-03-27 20:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c69ea11c-b0a1-524f-8a2c-34c4880a3d2c with identifier: NV96305
2026-03-27 20:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c69ea11c-b0a1-524f-8a2c-34c4880a3d2c with identifier: NV96305 to the API
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:22:36Z',
 'fuel_type': 'petrol',
 'id': 'c69ea11c-b0a1-524f-8a2c-34c4880a3d2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV96305',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 57240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV96305%27 HTTP/1.1" 200 None
2026-03-27 20:37:21 [auto1.be] INFO: Saving data for NV96305: {'auction_closing_time': 1774714956.0, 'created_time': 1774438568.377986, 'last_price_update_time': 1774643841.337255}
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV96305') HTTP/1.1" 204 0
2026-03-27 20:37:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:21 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN32726%27 HTTP/1.1" 200 None
2026-03-27 20:37:21 [auto1.be] INFO: Scrape type for PN32726: 2
2026-03-27 20:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2293d7c6-2bc4-51f0-976d-b831e65b7a7d with identifier: PN32726
2026-03-27 20:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2293d7c6-2bc4-51f0-976d-b831e65b7a7d with scrape type 2
2026-03-27 20:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2293d7c6-2bc4-51f0-976d-b831e65b7a7d with scrape type 2
2026-03-27 20:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2293d7c6-2bc4-51f0-976d-b831e65b7a7d, identifier: PN32726
2026-03-27 20:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2293d7c6-2bc4-51f0-976d-b831e65b7a7d with identifier: PN32726
2026-03-27 20:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2293d7c6-2bc4-51f0-976d-b831e65b7a7d with identifier: PN32726
2026-03-27 20:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2293d7c6-2bc4-51f0-976d-b831e65b7a7d with identifier: PN32726 to the API
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:01:16Z',
 'fuel_type': 'petrol',
 'id': '2293d7c6-2bc4-51f0-976d-b831e65b7a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN32726',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa 156',
 'odometer': 184044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-08-01',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 156 1.6 L T.Spark Distinctive',
 'transmission': 'manual',
 'trim': 'L T.Spark Distinctive',
 'year': 2001}
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN32726%27 HTTP/1.1" 200 None
2026-03-27 20:37:21 [auto1.be] INFO: Saving data for PN32726: {'auction_closing_time': 1774713676.0, 'created_time': 1773238226.200097, 'last_price_update_time': 1774643841.808063}
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PN32726') HTTP/1.1" 204 0
2026-03-27 20:37:21 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-27 20:37:21 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-27 20:37:21 [auto1.be] INFO: Scrape type for MR13936: 2
2026-03-27 20:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-27 20:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554c6eda-25b8-5f5c-b237-5fd019014ed8 with scrape type 2
2026-03-27 20:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554c6eda-25b8-5f5c-b237-5fd019014ed8 with scrape type 2
2026-03-27 20:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 554c6eda-25b8-5f5c-b237-5fd019014ed8, identifier: MR13936
2026-03-27 20:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af05e1a2-1283-5533-a60e-8b9edda2d492 with identifier: YK21410
2026-03-27 20:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af05e1a2-1283-5533-a60e-8b9edda2d492 with scrape type 1
2026-03-27 20:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af05e1a2-1283-5533-a60e-8b9edda2d492
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_ba87be48c98351283e0dfa03f941feac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_ba87be48c98351283e0dfa03f941feac.jpg already downloaded
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_dd15e1d9550ef7da135998e12efb6153.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_dd15e1d9550ef7da135998e12efb6153.jpg already downloaded
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_dbdf90cdf0c1e96756c8ec9f73820904.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_dbdf90cdf0c1e96756c8ec9f73820904.jpg already downloaded
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_61ec472d65534140eedfc334e87266b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_61ec472d65534140eedfc334e87266b3.jpg already downloaded
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_4e15c47c1145cc3e13fc8039d0d50066.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_4e15c47c1145cc3e13fc8039d0d50066.jpg already downloaded
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_b2b16591156ebc381a2e56166d313cd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_b2b16591156ebc381a2e56166d313cd3.jpg already downloaded
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_a50f2f55ac968c908c3318953ff1515f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_a50f2f55ac968c908c3318953ff1515f.jpg already downloaded
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_ca2fae04eceea212fc1a6ac7ad68e18d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_ca2fae04eceea212fc1a6ac7ad68e18d.jpg already downloaded
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_5f6a65899545860e2776e31198c0bbaf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_5f6a65899545860e2776e31198c0bbaf.jpg already downloaded
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Ff4%252F97f42d2d2a0ae1e137a22bedffd84543%252Fpa%252FYK21410_2c96c4a3b2704a3b0da2d29ea5f823c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_2c96c4a3b2704a3b0da2d29ea5f823c9.jpg already downloaded
2026-03-27 20:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af05e1a2-1283-5533-a60e-8b9edda2d492, identifier: YK21410
2026-03-27 20:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-27 20:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-27 20:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936 to the API
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:37:02Z',
 'fuel_type': 'diesel',
 'id': '554c6eda-25b8-5f5c-b237-5fd019014ed8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR13936',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 166842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-04-22',
 'seller_name': None,
 'title': 'Ford Mondeo 1.8 Turbodiesel CLX',
 'transmission': 'manual',
 'trim': 'CLX',
 'year': 2001}
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [auto1.be] INFO: Saving data for MR13936: {'auction_closing_time': 1774715822.0, 'created_time': 1773693907.204172, 'last_price_update_time': 1774643842.502672}
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR13936') HTTP/1.1" 204 0
2026-03-27 20:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af05e1a2-1283-5533-a60e-8b9edda2d492 with identifier: YK21410
2026-03-27 20:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af05e1a2-1283-5533-a60e-8b9edda2d492 with identifier: YK21410
2026-03-27 20:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af05e1a2-1283-5533-a60e-8b9edda2d492 with identifier: YK21410 to the API
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YK21410>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:16:18Z',
 'fuel_type': 'diesel',
 'id': 'af05e1a2-1283-5533-a60e-8b9edda2d492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK21410',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '3er',
 'odometer': 187999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_ba87be48c98351283e0dfa03f941feac.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_dd15e1d9550ef7da135998e12efb6153.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_dbdf90cdf0c1e96756c8ec9f73820904.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_61ec472d65534140eedfc334e87266b3.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_4e15c47c1145cc3e13fc8039d0d50066.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_b2b16591156ebc381a2e56166d313cd3.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_a50f2f55ac968c908c3318953ff1515f.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_ca2fae04eceea212fc1a6ac7ad68e18d.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_5f6a65899545860e2776e31198c0bbaf.jpg',
                'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_2c96c4a3b2704a3b0da2d29ea5f823c9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_ba87be48c98351283e0dfa03f941feac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_dd15e1d9550ef7da135998e12efb6153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_dbdf90cdf0c1e96756c8ec9f73820904.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_61ec472d65534140eedfc334e87266b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_4e15c47c1145cc3e13fc8039d0d50066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_b2b16591156ebc381a2e56166d313cd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_a50f2f55ac968c908c3318953ff1515f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_ca2fae04eceea212fc1a6ac7ad68e18d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_5f6a65899545860e2776e31198c0bbaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af05e1a2-1283-5533-a60e-8b9edda2d492/af05e1a2-1283-5533-a60e-8b9edda2d492_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/f4/97f42d2d2a0ae1e137a22bedffd84543/pa/YK21410_2c96c4a3b2704a3b0da2d29ea5f823c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d GT',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK21410%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [auto1.be] INFO: Saving data for YK21410: {'created_time': 1774643842.792783, 'last_price_update_time': 1774643842.792793, 'auction_closing_time': 1774714578.0}
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK21410') HTTP/1.1" 204 0
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK27252%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [auto1.be] INFO: Scrape type for VK27252: 0
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL06267%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [auto1.be] INFO: Scrape type for ZL06267: 0
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP77494%27 HTTP/1.1" 200 None
2026-03-27 20:37:22 [auto1.be] INFO: Scrape type for HP77494: 1
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-27 20:37:22 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-27 20:37:23 [auto1.be] INFO: Scrape type for YK73361: 2
2026-03-27 20:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-27 20:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with scrape type 2
2026-03-27 20:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with scrape type 2
2026-03-27 20:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66f0530b-7bb4-5c75-b619-81fb5fd46d51, identifier: YK73361
2026-03-27 20:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL98118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-27 20:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361
2026-03-27 20:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66f0530b-7bb4-5c75-b619-81fb5fd46d51 with identifier: YK73361 to the API
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:31:30Z',
 'fuel_type': 'diesel',
 'id': '66f0530b-7bb4-5c75-b619-81fb5fd46d51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK73361',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 141793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-27 20:37:23 [auto1.be] INFO: Saving data for YK73361: {'auction_closing_time': 1774715490.0, 'created_time': 1774557324.647236, 'last_price_update_time': 1774643843.381027}
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK73361') HTTP/1.1" 204 0
2026-03-27 20:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:23 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-27 20:37:23 [auto1.be] INFO: Scrape type for HJ67440: 2
2026-03-27 20:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-27 20:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22cd2476-acf9-5223-8aac-b88702901fdc with scrape type 2
2026-03-27 20:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22cd2476-acf9-5223-8aac-b88702901fdc with scrape type 2
2026-03-27 20:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22cd2476-acf9-5223-8aac-b88702901fdc, identifier: HJ67440
2026-03-27 20:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-27 20:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440
2026-03-27 20:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22cd2476-acf9-5223-8aac-b88702901fdc with identifier: HJ67440 to the API
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:25:55Z',
 'fuel_type': 'diesel',
 'id': '22cd2476-acf9-5223-8aac-b88702901fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ67440',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 157735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport D250 Mild-Hybrid HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2021}
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-27 20:37:23 [auto1.be] INFO: Saving data for HJ67440: {'auction_closing_time': 1774715155.0, 'created_time': 1774557327.728909, 'last_price_update_time': 1774643843.900378}
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ67440') HTTP/1.1" 204 0
2026-03-27 20:37:23 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-27 20:37:23 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-27 20:37:23 [auto1.be] INFO: Scrape type for UR96395: 1
2026-03-27 20:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:23 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-27 20:37:23 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-27 20:37:23 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM10661%27 HTTP/1.1" 200 None
2026-03-27 20:37:23 [auto1.be] INFO: Scrape type for LM10661: 2
2026-03-27 20:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f855965-b836-5bb3-8dd5-db92f63a625c with identifier: LM10661
2026-03-27 20:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f855965-b836-5bb3-8dd5-db92f63a625c with scrape type 2
2026-03-27 20:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f855965-b836-5bb3-8dd5-db92f63a625c with scrape type 2
2026-03-27 20:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f855965-b836-5bb3-8dd5-db92f63a625c, identifier: LM10661
2026-03-27 20:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f855965-b836-5bb3-8dd5-db92f63a625c with identifier: LM10661
2026-03-27 20:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f855965-b836-5bb3-8dd5-db92f63a625c with identifier: LM10661
2026-03-27 20:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f855965-b836-5bb3-8dd5-db92f63a625c with identifier: LM10661 to the API
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 462,
 'expiration_date': '2026-03-28T16:00:12Z',
 'fuel_type': 'hybrid',
 'id': '8f855965-b836-5bb3-8dd5-db92f63a625c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM10661',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 168951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Audi Q7 60 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM10661%27 HTTP/1.1" 200 None
2026-03-27 20:37:24 [auto1.be] INFO: Saving data for LM10661: {'auction_closing_time': 1774713612.0, 'created_time': 1774298253.469106, 'last_price_update_time': 1774643844.32754}
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM10661') HTTP/1.1" 204 0
2026-03-27 20:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:24 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-27 20:37:24 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:24 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ73148%27 HTTP/1.1" 200 None
2026-03-27 20:37:24 [auto1.be] INFO: Scrape type for WJ73148: 2
2026-03-27 20:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4395480f-8c82-55f2-b20d-5def0cd03d92 with identifier: WJ73148
2026-03-27 20:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4395480f-8c82-55f2-b20d-5def0cd03d92 with scrape type 2
2026-03-27 20:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4395480f-8c82-55f2-b20d-5def0cd03d92 with scrape type 2
2026-03-27 20:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4395480f-8c82-55f2-b20d-5def0cd03d92, identifier: WJ73148
2026-03-27 20:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4395480f-8c82-55f2-b20d-5def0cd03d92 with identifier: WJ73148
2026-03-27 20:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4395480f-8c82-55f2-b20d-5def0cd03d92 with identifier: WJ73148
2026-03-27 20:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4395480f-8c82-55f2-b20d-5def0cd03d92 with identifier: WJ73148 to the API
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:00:59Z',
 'fuel_type': 'petrol',
 'id': '4395480f-8c82-55f2-b20d-5def0cd03d92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ73148',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 113508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ73148%27 HTTP/1.1" 200 None
2026-03-27 20:37:24 [auto1.be] INFO: Saving data for WJ73148: {'auction_closing_time': 1774713659.0, 'created_time': 1773134805.704667, 'last_price_update_time': 1774643844.74059}
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ73148') HTTP/1.1" 204 0
2026-03-27 20:37:24 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-27 20:37:24 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-27 20:37:24 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-27 20:37:24 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-27 20:37:24 [auto1.be] INFO: Scrape type for XN45926: 2
2026-03-27 20:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926
2026-03-27 20:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5497cd11-5fb6-55a6-b576-674e59e137dc with scrape type 2
2026-03-27 20:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5497cd11-5fb6-55a6-b576-674e59e137dc with scrape type 2
2026-03-27 20:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5497cd11-5fb6-55a6-b576-674e59e137dc, identifier: XN45926
2026-03-27 20:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926
2026-03-27 20:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926
2026-03-27 20:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5497cd11-5fb6-55a6-b576-674e59e137dc with identifier: XN45926 to the API
2026-03-27 20:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:19:55Z',
 'fuel_type': 'petrol',
 'id': '5497cd11-5fb6-55a6-b576-674e59e137dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN45926',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 81921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Elle',
 'transmission': 'manual',
 'trim': 'Elle',
 'year': 2018}
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-27 20:37:25 [auto1.be] INFO: Saving data for XN45926: {'auction_closing_time': 1774714795.0, 'created_time': 1773134067.788698, 'last_price_update_time': 1774643845.183888}
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN45926') HTTP/1.1" 204 0
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB59400%27 HTTP/1.1" 200 None
2026-03-27 20:37:25 [auto1.be] INFO: Scrape type for UB59400: 1
2026-03-27 20:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP77494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA01247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-27 20:37:25 [auto1.be] INFO: Scrape type for FV38279: 2
2026-03-27 20:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279
2026-03-27 20:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with scrape type 2
2026-03-27 20:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with scrape type 2
2026-03-27 20:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07, identifier: FV38279
2026-03-27 20:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279
2026-03-27 20:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279
2026-03-27 20:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279 to the API
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:03:44Z',
 'fuel_type': 'petrol',
 'id': 'db3f6d01-1fec-55a2-8c18-c03d1f9dbf07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV38279',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 130476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-27 20:37:25 [auto1.be] INFO: Saving data for FV38279: {'auction_closing_time': 1774713824.0, 'created_time': 1774038992.479627, 'last_price_update_time': 1774643845.689752}
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV38279') HTTP/1.1" 204 0
2026-03-27 20:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-27 20:37:25 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY06710%27 HTTP/1.1" 200 None
2026-03-27 20:37:25 [auto1.be] INFO: Scrape type for EY06710: 2
2026-03-27 20:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e0140de-f0e8-583e-9dbc-74e13fc128da with identifier: EY06710
2026-03-27 20:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e0140de-f0e8-583e-9dbc-74e13fc128da with scrape type 2
2026-03-27 20:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e0140de-f0e8-583e-9dbc-74e13fc128da with scrape type 2
2026-03-27 20:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e0140de-f0e8-583e-9dbc-74e13fc128da, identifier: EY06710
2026-03-27 20:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e0140de-f0e8-583e-9dbc-74e13fc128da with identifier: EY06710
2026-03-27 20:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e0140de-f0e8-583e-9dbc-74e13fc128da with identifier: EY06710
2026-03-27 20:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e0140de-f0e8-583e-9dbc-74e13fc128da with identifier: EY06710 to the API
2026-03-27 20:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:05:01Z',
 'fuel_type': 'diesel',
 'id': '0e0140de-f0e8-583e-9dbc-74e13fc128da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY06710',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 103334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L4 Trend',
 'transmission': 'automatic',
 'trim': '350 L4 Trend',
 'year': 2022}
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY06710%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Saving data for EY06710: {'auction_closing_time': 1774713901.0, 'created_time': 1773240123.955073, 'last_price_update_time': 1774643846.152384}
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EY06710') HTTP/1.1" 204 0
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX67951%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for RX67951: 2
2026-03-27 20:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547ff31c-b70e-5bea-adbd-b3edfebbfa2f with identifier: RX67951
2026-03-27 20:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547ff31c-b70e-5bea-adbd-b3edfebbfa2f with scrape type 2
2026-03-27 20:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 547ff31c-b70e-5bea-adbd-b3edfebbfa2f with scrape type 2
2026-03-27 20:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 547ff31c-b70e-5bea-adbd-b3edfebbfa2f, identifier: RX67951
2026-03-27 20:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 547ff31c-b70e-5bea-adbd-b3edfebbfa2f with identifier: RX67951
2026-03-27 20:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 547ff31c-b70e-5bea-adbd-b3edfebbfa2f with identifier: RX67951
2026-03-27 20:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 547ff31c-b70e-5bea-adbd-b3edfebbfa2f with identifier: RX67951 to the API
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:46:21Z',
 'fuel_type': 'petrol',
 'id': '547ff31c-b70e-5bea-adbd-b3edfebbfa2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX67951',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 228390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.4 Multispace',
 'transmission': 'manual',
 'trim': 'Multispace',
 'year': 2004}
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX67951%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Saving data for RX67951: {'auction_closing_time': 1774716381.0, 'created_time': 1773953243.667533, 'last_price_update_time': 1774643846.527297}
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX67951') HTTP/1.1" 204 0
2026-03-27 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM98751%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for ZM98751: 1
2026-03-27 20:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU69949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU29895%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for YU29895: 1
2026-03-27 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC47788%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for PC47788: 1
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ17204%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for XJ17204: 1
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX95723%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for JX95723: 1
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP70611%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for JP70611: 1
2026-03-27 20:37:26 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20411%27 HTTP/1.1" 200 None
2026-03-27 20:37:26 [auto1.be] INFO: Scrape type for BY20411: 2
2026-03-27 20:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa494ff-020f-50f2-8e9c-ba2623b182cb with identifier: BY20411
2026-03-27 20:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa494ff-020f-50f2-8e9c-ba2623b182cb with scrape type 2
2026-03-27 20:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa494ff-020f-50f2-8e9c-ba2623b182cb with scrape type 2
2026-03-27 20:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8fa494ff-020f-50f2-8e9c-ba2623b182cb, identifier: BY20411
2026-03-27 20:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8fa494ff-020f-50f2-8e9c-ba2623b182cb with identifier: BY20411
2026-03-27 20:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8fa494ff-020f-50f2-8e9c-ba2623b182cb with identifier: BY20411
2026-03-27 20:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8fa494ff-020f-50f2-8e9c-ba2623b182cb with identifier: BY20411 to the API
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:24:40Z',
 'fuel_type': 'diesel',
 'id': '8fa494ff-020f-50f2-8e9c-ba2623b182cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY20411',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 193717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-25',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130',
 'transmission': 'manual',
 'trim': '130',
 'year': 2013}
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20411%27 HTTP/1.1" 200 None
2026-03-27 20:37:27 [auto1.be] INFO: Saving data for BY20411: {'auction_closing_time': 1774715080.0, 'created_time': 1773225371.565467, 'last_price_update_time': 1774643847.048245}
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY20411') HTTP/1.1" 204 0
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED46000%27 HTTP/1.1" 200 None
2026-03-27 20:37:27 [auto1.be] INFO: Scrape type for ED46000: 1
2026-03-27 20:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX42019/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR96395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU65745%27 HTTP/1.1" 200 None
2026-03-27 20:37:27 [auto1.be] INFO: Scrape type for MU65745: 1
2026-03-27 20:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-27 20:37:27 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV66357%27 HTTP/1.1" 200 None
2026-03-27 20:37:27 [auto1.be] INFO: Scrape type for UV66357: 2
2026-03-27 20:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7674d3ba-dda3-5025-b96b-19e9370fed19 with identifier: UV66357
2026-03-27 20:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7674d3ba-dda3-5025-b96b-19e9370fed19 with scrape type 2
2026-03-27 20:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7674d3ba-dda3-5025-b96b-19e9370fed19 with scrape type 2
2026-03-27 20:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7674d3ba-dda3-5025-b96b-19e9370fed19, identifier: UV66357
2026-03-27 20:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7674d3ba-dda3-5025-b96b-19e9370fed19 with identifier: UV66357
2026-03-27 20:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7674d3ba-dda3-5025-b96b-19e9370fed19 with identifier: UV66357
2026-03-27 20:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7674d3ba-dda3-5025-b96b-19e9370fed19 with identifier: UV66357 to the API
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:56:41Z',
 'fuel_type': 'petrol',
 'id': '7674d3ba-dda3-5025-b96b-19e9370fed19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV66357',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 110923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-25',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Black Shadow 4x2',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x2',
 'year': 2018}
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV66357%27 HTTP/1.1" 200 None
2026-03-27 20:37:27 [auto1.be] INFO: Saving data for UV66357: {'auction_closing_time': 1774717001.0, 'created_time': 1773301679.252814, 'last_price_update_time': 1774643847.733649}
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV66357') HTTP/1.1" 204 0
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-27 20:37:27 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU96332%27 HTTP/1.1" 200 None
2026-03-27 20:37:27 [auto1.be] INFO: Scrape type for XU96332: 2
2026-03-27 20:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f3ca3f-265c-5ade-ad5d-5f32774b8e13 with identifier: XU96332
2026-03-27 20:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f3ca3f-265c-5ade-ad5d-5f32774b8e13 with scrape type 2
2026-03-27 20:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f3ca3f-265c-5ade-ad5d-5f32774b8e13 with scrape type 2
2026-03-27 20:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d5f3ca3f-265c-5ade-ad5d-5f32774b8e13, identifier: XU96332
2026-03-27 20:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d5f3ca3f-265c-5ade-ad5d-5f32774b8e13 with identifier: XU96332
2026-03-27 20:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d5f3ca3f-265c-5ade-ad5d-5f32774b8e13 with identifier: XU96332
2026-03-27 20:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d5f3ca3f-265c-5ade-ad5d-5f32774b8e13 with identifier: XU96332 to the API
2026-03-27 20:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:37:33Z',
 'fuel_type': 'diesel',
 'id': 'd5f3ca3f-265c-5ade-ad5d-5f32774b8e13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU96332',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 101745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2019}
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU96332%27 HTTP/1.1" 200 None
2026-03-27 20:37:28 [auto1.be] INFO: Saving data for XU96332: {'auction_closing_time': 1774715853.0, 'created_time': 1774471324.402668, 'last_price_update_time': 1774643848.129876}
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU96332') HTTP/1.1" 204 0
2026-03-27 20:37:28 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS41207%27 HTTP/1.1" 200 None
2026-03-27 20:37:28 [auto1.be] INFO: Scrape type for GS41207: 2
2026-03-27 20:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71bddadf-a79f-52f5-8229-76d8cd1c83d8 with identifier: GS41207
2026-03-27 20:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71bddadf-a79f-52f5-8229-76d8cd1c83d8 with scrape type 2
2026-03-27 20:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71bddadf-a79f-52f5-8229-76d8cd1c83d8 with scrape type 2
2026-03-27 20:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71bddadf-a79f-52f5-8229-76d8cd1c83d8, identifier: GS41207
2026-03-27 20:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71bddadf-a79f-52f5-8229-76d8cd1c83d8 with identifier: GS41207
2026-03-27 20:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71bddadf-a79f-52f5-8229-76d8cd1c83d8 with identifier: GS41207
2026-03-27 20:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71bddadf-a79f-52f5-8229-76d8cd1c83d8 with identifier: GS41207 to the API
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:19:09Z',
 'fuel_type': 'petrol',
 'id': '71bddadf-a79f-52f5-8229-76d8cd1c83d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS41207',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 140569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'MINI Cooper Seven Chili',
 'transmission': 'automatic',
 'trim': 'Seven Chili',
 'year': 2017}
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS41207%27 HTTP/1.1" 200 None
2026-03-27 20:37:28 [auto1.be] INFO: Saving data for GS41207: {'auction_closing_time': 1774714749.0, 'created_time': 1774471404.705113, 'last_price_update_time': 1774643848.653347}
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS41207') HTTP/1.1" 204 0
2026-03-27 20:37:28 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-27 20:37:28 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU53193%27 HTTP/1.1" 200 None
2026-03-27 20:37:28 [auto1.be] INFO: Scrape type for SU53193: 2
2026-03-27 20:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a4fc4db-8097-52e6-9047-bfa32fa194a8 with identifier: SU53193
2026-03-27 20:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a4fc4db-8097-52e6-9047-bfa32fa194a8 with scrape type 2
2026-03-27 20:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a4fc4db-8097-52e6-9047-bfa32fa194a8 with scrape type 2
2026-03-27 20:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a4fc4db-8097-52e6-9047-bfa32fa194a8, identifier: SU53193
2026-03-27 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP77494> (referer: https://www.auto1.com/v1/car-details-view/HP77494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB59400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA01247> (referer: https://www.auto1.com/v1/car-details-view/PA01247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM98751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL98118> (referer: https://www.auto1.com/v1/car-details-view/UL98118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a4fc4db-8097-52e6-9047-bfa32fa194a8 with identifier: SU53193
2026-03-27 20:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a4fc4db-8097-52e6-9047-bfa32fa194a8 with identifier: SU53193
2026-03-27 20:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a4fc4db-8097-52e6-9047-bfa32fa194a8 with identifier: SU53193 to the API
2026-03-27 20:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:56:55Z',
 'fuel_type': 'diesel',
 'id': '8a4fc4db-8097-52e6-9047-bfa32fa194a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU53193',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 129903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-27 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU53193%27 HTTP/1.1" 200 None
2026-03-27 20:37:29 [auto1.be] INFO: Saving data for SU53193: {'auction_closing_time': 1774717015.0, 'created_time': 1774471349.729336, 'last_price_update_time': 1774643849.880749}
2026-03-27 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU53193') HTTP/1.1" 204 0
2026-03-27 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:29 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-27 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG72902%27 HTTP/1.1" 200 None
2026-03-27 20:37:29 [auto1.be] INFO: Scrape type for EG72902: 2
2026-03-27 20:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be33a9eb-92e6-5604-9dc9-f189e99df2b2 with identifier: EG72902
2026-03-27 20:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be33a9eb-92e6-5604-9dc9-f189e99df2b2 with scrape type 2
2026-03-27 20:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be33a9eb-92e6-5604-9dc9-f189e99df2b2 with scrape type 2
2026-03-27 20:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: be33a9eb-92e6-5604-9dc9-f189e99df2b2, identifier: EG72902
2026-03-27 20:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: be33a9eb-92e6-5604-9dc9-f189e99df2b2 with identifier: EG72902
2026-03-27 20:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: be33a9eb-92e6-5604-9dc9-f189e99df2b2 with identifier: EG72902
2026-03-27 20:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: be33a9eb-92e6-5604-9dc9-f189e99df2b2 with identifier: EG72902 to the API
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-28T16:26:31Z',
 'fuel_type': 'hybrid',
 'id': 'be33a9eb-92e6-5604-9dc9-f189e99df2b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG72902',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 148724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2016}
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG72902%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [auto1.be] INFO: Saving data for EG72902: {'auction_closing_time': 1774715191.0, 'created_time': 1774471321.171779, 'last_price_update_time': 1774643850.30937}
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EG72902') HTTP/1.1" 204 0
2026-03-27 20:37:30 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-27 20:37:30 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC45178%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [auto1.be] INFO: Scrape type for YC45178: 2
2026-03-27 20:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 548c9021-ca53-5841-8293-7f663914e2fc with identifier: YC45178
2026-03-27 20:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 548c9021-ca53-5841-8293-7f663914e2fc with scrape type 2
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 548c9021-ca53-5841-8293-7f663914e2fc with scrape type 2
2026-03-27 20:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 548c9021-ca53-5841-8293-7f663914e2fc, identifier: YC45178
2026-03-27 20:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 548c9021-ca53-5841-8293-7f663914e2fc with identifier: YC45178
2026-03-27 20:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 548c9021-ca53-5841-8293-7f663914e2fc with identifier: YC45178
2026-03-27 20:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 548c9021-ca53-5841-8293-7f663914e2fc with identifier: YC45178 to the API
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:40:54Z',
 'fuel_type': 'diesel',
 'id': '548c9021-ca53-5841-8293-7f663914e2fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC45178',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 174267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC45178%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [auto1.be] INFO: Saving data for YC45178: {'auction_closing_time': 1774716054.0, 'created_time': 1774471380.464999, 'last_price_update_time': 1774643850.69152}
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC45178') HTTP/1.1" 204 0
2026-03-27 20:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1ef985-5a5f-51d0-b3fb-77cb9a5db112 with identifier: HP77494
2026-03-27 20:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1ef985-5a5f-51d0-b3fb-77cb9a5db112 with scrape type 1
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c1ef985-5a5f-51d0-b3fb-77cb9a5db112
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_fece22fd1a4c176bb2755e71b3df81bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_fece22fd1a4c176bb2755e71b3df81bb.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_69d7405a1fdfd5283c53155a290ad3eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_69d7405a1fdfd5283c53155a290ad3eb.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_b237145349961a86b8e28b2da2e7bd3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_b237145349961a86b8e28b2da2e7bd3c.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_3bc7fe766bb2f3a026d622447db48c61.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_3bc7fe766bb2f3a026d622447db48c61.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_d05ea2a8395b8e4b1dda404b90f4cc0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_d05ea2a8395b8e4b1dda404b90f4cc0f.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_f180a31d1003a6bbc621687152ab1638.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_f180a31d1003a6bbc621687152ab1638.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_385c2d6e9f7d71cf372581de0a403647.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_385c2d6e9f7d71cf372581de0a403647.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_97d4f88b566486f43d1bd6f649af9dee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_97d4f88b566486f43d1bd6f649af9dee.jpg already downloaded
2026-03-27 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_2eaff9bdbd5412973b9090505b4bdbfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_2eaff9bdbd5412973b9090505b4bdbfb.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5b%252Fd05b75af59c04f1c23d5659f386db1e3%252Fpa%252FHP77494_c94f14caa0aee58881f62a650e52c848.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_c94f14caa0aee58881f62a650e52c848.jpg already downloaded
2026-03-27 20:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c1ef985-5a5f-51d0-b3fb-77cb9a5db112, identifier: HP77494
2026-03-27 20:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa401aad-c444-55b9-8440-345ed3c79912 with identifier: PA01247
2026-03-27 20:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa401aad-c444-55b9-8440-345ed3c79912 with scrape type 1
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa401aad-c444-55b9-8440-345ed3c79912
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_3bf16380e9c4ef21e52f92135849bf0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_3bf16380e9c4ef21e52f92135849bf0d.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_5a9663cbd3a44c5481adaed30aa7bcb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_5a9663cbd3a44c5481adaed30aa7bcb0.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_19ac0bf3afec72a450cd9df15bbc80cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_19ac0bf3afec72a450cd9df15bbc80cf.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_59af8c1c4049b01a541665709d1b4915.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_59af8c1c4049b01a541665709d1b4915.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_344601489ec6a494fd2a87391c4d98cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_344601489ec6a494fd2a87391c4d98cf.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_61ece59790c320cf139ded1e9210252c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_61ece59790c320cf139ded1e9210252c.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_be908b0bef97cf3a548566aa4536b9f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_be908b0bef97cf3a548566aa4536b9f1.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_5d68418b80399b2b5781bcb356c3842d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_5d68418b80399b2b5781bcb356c3842d.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_bd7d14f90d91c7e6a6e5501f643b934a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_bd7d14f90d91c7e6a6e5501f643b934a.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F24%252F9d24a825510e0a918ea2f3d6750a1880%252Fpa%252FPA01247_7ec18821067902222bfe489f63fb0fcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_7ec18821067902222bfe489f63fb0fcb.jpg already downloaded
2026-03-27 20:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa401aad-c444-55b9-8440-345ed3c79912, identifier: PA01247
2026-03-27 20:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4f2aa2-d908-5a0d-b0ef-900f6c16af27 with identifier: UL98118
2026-03-27 20:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4f2aa2-d908-5a0d-b0ef-900f6c16af27 with scrape type 1
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a4f2aa2-d908-5a0d-b0ef-900f6c16af27
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_6b4ea7f44611d69b6371388bc407280c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_6b4ea7f44611d69b6371388bc407280c.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_499f1c0fcf2012304555b26b8b3506ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_499f1c0fcf2012304555b26b8b3506ca.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_05860b13704990de43dc0692189cfbbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_05860b13704990de43dc0692189cfbbd.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_129e4983c1ad61a1ac61fe007c8ea0f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_129e4983c1ad61a1ac61fe007c8ea0f3.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_6a1a3a7308123040a4b79024d817bb10.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_6a1a3a7308123040a4b79024d817bb10.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_1055ab0f332eb55efd775ebc381c51b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_1055ab0f332eb55efd775ebc381c51b3.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_8f53a8d2cea4da58d5d926f3183bb582.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_8f53a8d2cea4da58d5d926f3183bb582.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_462077e91034a4ce73200efec6da1355.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_462077e91034a4ce73200efec6da1355.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_5898d4f831851c60ee89c84f3611fc4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_5898d4f831851c60ee89c84f3611fc4c.jpg already downloaded
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd002401c006d76feb23a663c590f0ef1%252Fpa%252FUL98118_d79d0083a04a21961c71db6c35726e01.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_d79d0083a04a21961c71db6c35726e01.jpg already downloaded
2026-03-27 20:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a4f2aa2-d908-5a0d-b0ef-900f6c16af27, identifier: UL98118
2026-03-27 20:37:31 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-27 20:37:31 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU26363%27 HTTP/1.1" 200 None
2026-03-27 20:37:31 [auto1.be] INFO: Scrape type for ZU26363: 2
2026-03-27 20:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d89dec-0f9b-5ddb-be3e-441470588f4f with identifier: ZU26363
2026-03-27 20:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d89dec-0f9b-5ddb-be3e-441470588f4f with scrape type 2
2026-03-27 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9d89dec-0f9b-5ddb-be3e-441470588f4f with scrape type 2
2026-03-27 20:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9d89dec-0f9b-5ddb-be3e-441470588f4f, identifier: ZU26363
2026-03-27 20:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c1ef985-5a5f-51d0-b3fb-77cb9a5db112 with identifier: HP77494
2026-03-27 20:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c1ef985-5a5f-51d0-b3fb-77cb9a5db112 with identifier: HP77494
2026-03-27 20:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c1ef985-5a5f-51d0-b3fb-77cb9a5db112 with identifier: HP77494 to the API
2026-03-27 20:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HP77494>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:51:04Z',
 'fuel_type': 'hybrid',
 'id': '8c1ef985-5a5f-51d0-b3fb-77cb9a5db112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP77494',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 98398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_fece22fd1a4c176bb2755e71b3df81bb.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_69d7405a1fdfd5283c53155a290ad3eb.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_b237145349961a86b8e28b2da2e7bd3c.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_3bc7fe766bb2f3a026d622447db48c61.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_d05ea2a8395b8e4b1dda404b90f4cc0f.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_f180a31d1003a6bbc621687152ab1638.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_385c2d6e9f7d71cf372581de0a403647.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_97d4f88b566486f43d1bd6f649af9dee.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_2eaff9bdbd5412973b9090505b4bdbfb.jpg',
                'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_c94f14caa0aee58881f62a650e52c848.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_fece22fd1a4c176bb2755e71b3df81bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_69d7405a1fdfd5283c53155a290ad3eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_b237145349961a86b8e28b2da2e7bd3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_3bc7fe766bb2f3a026d622447db48c61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_d05ea2a8395b8e4b1dda404b90f4cc0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_f180a31d1003a6bbc621687152ab1638.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_385c2d6e9f7d71cf372581de0a403647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_97d4f88b566486f43d1bd6f649af9dee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_2eaff9bdbd5412973b9090505b4bdbfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c1ef985-5a5f-51d0-b3fb-77cb9a5db112/8c1ef985-5a5f-51d0-b3fb-77cb9a5db112_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5b/d05b75af59c04f1c23d5659f386db1e3/pa/HP77494_c94f14caa0aee58881f62a650e52c848.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 Allure',
 'transmission': 'automatic',
 'trim': '225 Allure',
 'year': 2020}
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP77494%27 HTTP/1.1" 200 None
2026-03-27 20:37:32 [auto1.be] INFO: Saving data for HP77494: {'created_time': 1774643852.154661, 'last_price_update_time': 1774643852.154674, 'auction_closing_time': 1774716664.0}
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP77494') HTTP/1.1" 204 0
2026-03-27 20:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa401aad-c444-55b9-8440-345ed3c79912 with identifier: PA01247
2026-03-27 20:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa401aad-c444-55b9-8440-345ed3c79912 with identifier: PA01247
2026-03-27 20:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa401aad-c444-55b9-8440-345ed3c79912 with identifier: PA01247 to the API
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PA01247>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:51:04Z',
 'fuel_type': 'diesel',
 'id': 'fa401aad-c444-55b9-8440-345ed3c79912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA01247',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 277570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_3bf16380e9c4ef21e52f92135849bf0d.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_5a9663cbd3a44c5481adaed30aa7bcb0.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_19ac0bf3afec72a450cd9df15bbc80cf.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_59af8c1c4049b01a541665709d1b4915.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_344601489ec6a494fd2a87391c4d98cf.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_61ece59790c320cf139ded1e9210252c.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_be908b0bef97cf3a548566aa4536b9f1.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_5d68418b80399b2b5781bcb356c3842d.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_bd7d14f90d91c7e6a6e5501f643b934a.jpg',
                'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_7ec18821067902222bfe489f63fb0fcb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_3bf16380e9c4ef21e52f92135849bf0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_5a9663cbd3a44c5481adaed30aa7bcb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_19ac0bf3afec72a450cd9df15bbc80cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_59af8c1c4049b01a541665709d1b4915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_344601489ec6a494fd2a87391c4d98cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_61ece59790c320cf139ded1e9210252c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_be908b0bef97cf3a548566aa4536b9f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_5d68418b80399b2b5781bcb356c3842d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_bd7d14f90d91c7e6a6e5501f643b934a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa401aad-c444-55b9-8440-345ed3c79912/fa401aad-c444-55b9-8440-345ed3c79912_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/24/9d24a825510e0a918ea2f3d6750a1880/pa/PA01247_7ec18821067902222bfe489f63fb0fcb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA01247%27 HTTP/1.1" 200 None
2026-03-27 20:37:32 [auto1.be] INFO: Saving data for PA01247: {'created_time': 1774643852.446289, 'last_price_update_time': 1774643852.446299, 'auction_closing_time': 1774716664.0}
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PA01247') HTTP/1.1" 204 0
2026-03-27 20:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a4f2aa2-d908-5a0d-b0ef-900f6c16af27 with identifier: UL98118
2026-03-27 20:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a4f2aa2-d908-5a0d-b0ef-900f6c16af27 with identifier: UL98118
2026-03-27 20:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a4f2aa2-d908-5a0d-b0ef-900f6c16af27 with identifier: UL98118 to the API
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL98118>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:28:31Z',
 'fuel_type': 'diesel',
 'id': '7a4f2aa2-d908-5a0d-b0ef-900f6c16af27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL98118',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 65419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_6b4ea7f44611d69b6371388bc407280c.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_499f1c0fcf2012304555b26b8b3506ca.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_05860b13704990de43dc0692189cfbbd.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_129e4983c1ad61a1ac61fe007c8ea0f3.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_6a1a3a7308123040a4b79024d817bb10.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_1055ab0f332eb55efd775ebc381c51b3.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_8f53a8d2cea4da58d5d926f3183bb582.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_462077e91034a4ce73200efec6da1355.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_5898d4f831851c60ee89c84f3611fc4c.jpg',
                'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_d79d0083a04a21961c71db6c35726e01.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_6b4ea7f44611d69b6371388bc407280c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_499f1c0fcf2012304555b26b8b3506ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_05860b13704990de43dc0692189cfbbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_129e4983c1ad61a1ac61fe007c8ea0f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_6a1a3a7308123040a4b79024d817bb10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_1055ab0f332eb55efd775ebc381c51b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_8f53a8d2cea4da58d5d926f3183bb582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_462077e91034a4ce73200efec6da1355.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_5898d4f831851c60ee89c84f3611fc4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4f2aa2-d908-5a0d-b0ef-900f6c16af27/7a4f2aa2-d908-5a0d-b0ef-900f6c16af27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d002401c006d76feb23a663c590f0ef1/pa/UL98118_d79d0083a04a21961c71db6c35726e01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2019}
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL98118%27 HTTP/1.1" 200 None
2026-03-27 20:37:32 [auto1.be] INFO: Saving data for UL98118: {'created_time': 1774643852.728548, 'last_price_update_time': 1774643852.728558, 'auction_closing_time': 1774715311.0}
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL98118') HTTP/1.1" 204 0
2026-03-27 20:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9d89dec-0f9b-5ddb-be3e-441470588f4f with identifier: ZU26363
2026-03-27 20:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9d89dec-0f9b-5ddb-be3e-441470588f4f with identifier: ZU26363
2026-03-27 20:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9d89dec-0f9b-5ddb-be3e-441470588f4f with identifier: ZU26363 to the API
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:05Z',
 'fuel_type': 'diesel',
 'id': 'c9d89dec-0f9b-5ddb-be3e-441470588f4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU26363',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 72007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-16',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'manual',
 'trim': 'SE AWD',
 'year': 2017}
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU26363%27 HTTP/1.1" 200 None
2026-03-27 20:37:33 [auto1.be] INFO: Saving data for ZU26363: {'auction_closing_time': 1774716845.0, 'created_time': 1774438603.311463, 'last_price_update_time': 1774643853.031138}
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU26363') HTTP/1.1" 204 0
2026-03-27 20:37:33 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ61910%27 HTTP/1.1" 200 None
2026-03-27 20:37:33 [auto1.be] INFO: Scrape type for ZJ61910: 1
2026-03-27 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ17204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU29895/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC47788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:33 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-27 20:37:33 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-27 20:37:33 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH02429%27 HTTP/1.1" 200 None
2026-03-27 20:37:33 [auto1.be] INFO: Scrape type for PH02429: 2
2026-03-27 20:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d20f55-9418-5f63-a0d3-2906d79bb31f with identifier: PH02429
2026-03-27 20:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d20f55-9418-5f63-a0d3-2906d79bb31f with scrape type 2
2026-03-27 20:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63d20f55-9418-5f63-a0d3-2906d79bb31f with scrape type 2
2026-03-27 20:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63d20f55-9418-5f63-a0d3-2906d79bb31f, identifier: PH02429
2026-03-27 20:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63d20f55-9418-5f63-a0d3-2906d79bb31f with identifier: PH02429
2026-03-27 20:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63d20f55-9418-5f63-a0d3-2906d79bb31f with identifier: PH02429
2026-03-27 20:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63d20f55-9418-5f63-a0d3-2906d79bb31f with identifier: PH02429 to the API
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:50:49Z',
 'fuel_type': 'petrol',
 'id': '63d20f55-9418-5f63-a0d3-2906d79bb31f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH02429',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 205888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-12',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH02429%27 HTTP/1.1" 200 None
2026-03-27 20:37:33 [auto1.be] INFO: Saving data for PH02429: {'auction_closing_time': 1774716649.0, 'created_time': 1774471356.572678, 'last_price_update_time': 1774643853.449933}
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH02429') HTTP/1.1" 204 0
2026-03-27 20:37:33 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-27 20:37:33 [auto1.be] INFO: Scrape type for BV41613: 1
2026-03-27 20:37:33 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-27 20:37:33 [auto1.be] INFO: Scrape type for MZ51776: 2
2026-03-27 20:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-27 20:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6ac897-8ff7-5823-8019-bd26b347b4a1 with scrape type 2
2026-03-27 20:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe6ac897-8ff7-5823-8019-bd26b347b4a1 with scrape type 2
2026-03-27 20:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fe6ac897-8ff7-5823-8019-bd26b347b4a1, identifier: MZ51776
2026-03-27 20:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-27 20:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776
2026-03-27 20:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fe6ac897-8ff7-5823-8019-bd26b347b4a1 with identifier: MZ51776 to the API
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:06:19Z',
 'fuel_type': 'diesel',
 'id': 'fe6ac897-8ff7-5823-8019-bd26b347b4a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ51776',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 211489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-06',
 'seller_name': None,
 'title': 'Jaguar XF 2.2 D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Saving data for MZ51776: {'auction_closing_time': 1774713979.0, 'created_time': 1773834430.534744, 'last_price_update_time': 1774643854.035131}
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ51776') HTTP/1.1" 204 0
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for JJ27182: 1
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for SD77902: 1
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK22486%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for RK22486: 1
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for ZM54686: 1
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for BV56621: 1
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for HM47736: 1
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for AB44644: 2
2026-03-27 20:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-27 20:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7720042d-1a73-513f-8346-94b4dbcccc53 with scrape type 2
2026-03-27 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7720042d-1a73-513f-8346-94b4dbcccc53 with scrape type 2
2026-03-27 20:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7720042d-1a73-513f-8346-94b4dbcccc53, identifier: AB44644
2026-03-27 20:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-27 20:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644
2026-03-27 20:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7720042d-1a73-513f-8346-94b4dbcccc53 with identifier: AB44644 to the API
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:45:31Z',
 'fuel_type': 'petrol',
 'id': '7720042d-1a73-513f-8346-94b4dbcccc53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB44644',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 116152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-11',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2018}
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Saving data for AB44644: {'auction_closing_time': 1774716331.0, 'created_time': 1773834552.488357, 'last_price_update_time': 1774643854.562257}
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB44644') HTTP/1.1" 204 0
2026-03-27 20:37:34 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-27 20:37:34 [auto1.be] INFO: Scrape type for SR93497: 2
2026-03-27 20:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-27 20:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb44c10-e870-5f23-ba13-d7d9521f4351 with scrape type 2
2026-03-27 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb44c10-e870-5f23-ba13-d7d9521f4351 with scrape type 2
2026-03-27 20:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb44c10-e870-5f23-ba13-d7d9521f4351, identifier: SR93497
2026-03-27 20:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-27 20:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497
2026-03-27 20:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb44c10-e870-5f23-ba13-d7d9521f4351 with identifier: SR93497 to the API
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:19:14Z',
 'fuel_type': 'diesel',
 'id': '5cb44c10-e870-5f23-ba13-d7d9521f4351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR93497',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 213675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Saving data for SR93497: {'auction_closing_time': 1774714754.0, 'created_time': 1773779797.168772, 'last_price_update_time': 1774643855.037309}
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR93497') HTTP/1.1" 204 0
2026-03-27 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP70611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU65745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:35 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Scrape type for SR49598: 2
2026-03-27 20:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-27 20:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497af0eb-e19b-5f91-ad5a-aa140478438e with scrape type 2
2026-03-27 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497af0eb-e19b-5f91-ad5a-aa140478438e with scrape type 2
2026-03-27 20:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 497af0eb-e19b-5f91-ad5a-aa140478438e, identifier: SR49598
2026-03-27 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX95723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-27 20:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598
2026-03-27 20:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 497af0eb-e19b-5f91-ad5a-aa140478438e with identifier: SR49598 to the API
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:59:36Z',
 'fuel_type': 'diesel',
 'id': '497af0eb-e19b-5f91-ad5a-aa140478438e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR49598',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 165232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Saving data for SR49598: {'auction_closing_time': 1774717176.0, 'created_time': 1773909326.499568, 'last_price_update_time': 1774643855.439788}
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR49598') HTTP/1.1" 204 0
2026-03-27 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:35 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Scrape type for MG12074: 1
2026-03-27 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR96395> (referer: https://www.auto1.com/v1/car-details-view/UR96395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU69949> (referer: https://www.auto1.com/v1/car-details-view/YU69949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX42019> (referer: https://www.auto1.com/v1/car-details-view/HX42019/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:35 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP17871%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Scrape type for SP17871: 1
2026-03-27 20:37:35 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-27 20:37:35 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Scrape type for SS18683: 2
2026-03-27 20:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-27 20:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f3df223-d8e8-5ca7-b738-87c3dc67237a with scrape type 2
2026-03-27 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f3df223-d8e8-5ca7-b738-87c3dc67237a with scrape type 2
2026-03-27 20:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f3df223-d8e8-5ca7-b738-87c3dc67237a, identifier: SS18683
2026-03-27 20:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-27 20:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683
2026-03-27 20:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f3df223-d8e8-5ca7-b738-87c3dc67237a with identifier: SS18683 to the API
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:40:14Z',
 'fuel_type': 'diesel',
 'id': '1f3df223-d8e8-5ca7-b738-87c3dc67237a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS18683',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 117236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2016}
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Saving data for SS18683: {'auction_closing_time': 1774716014.0, 'created_time': 1773434504.189128, 'last_price_update_time': 1774643855.870028}
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SS18683') HTTP/1.1" 204 0
2026-03-27 20:37:35 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-27 20:37:35 [auto1.be] INFO: Scrape type for LJ62513: 2
2026-03-27 20:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513
2026-03-27 20:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with scrape type 2
2026-03-27 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with scrape type 2
2026-03-27 20:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 349b8d4d-e3d9-5ebb-ae51-d4379048a244, identifier: LJ62513
2026-03-27 20:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513
2026-03-27 20:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513
2026-03-27 20:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513 to the API
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:19:31Z',
 'fuel_type': 'petrol',
 'id': '349b8d4d-e3d9-5ebb-ae51-d4379048a244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ62513',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 52061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-17',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2022}
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [auto1.be] INFO: Saving data for LJ62513: {'auction_closing_time': 1774714771.0, 'created_time': 1774298190.150234, 'last_price_update_time': 1774643856.255914}
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LJ62513') HTTP/1.1" 204 0
2026-03-27 20:37:36 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-27 20:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with scrape type 1
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bc31ab03-abfe-5ea7-8fa8-df70e9489f69
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F59%252Fb65989e50d721fdb029dfcc7548f7be7%252Fpa%252FUR96395_7853c41f472cca08ee0907c18348ee6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_7853c41f472cca08ee0907c18348ee6f.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F59%252Fb65989e50d721fdb029dfcc7548f7be7%252Fpa%252FUR96395_ceca1be394326f63c99235f0b139fd88.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_ceca1be394326f63c99235f0b139fd88.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F59%252Fb65989e50d721fdb029dfcc7548f7be7%252Fpa%252FUR96395_2fc57d9b23be592027e0244d4b998baa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_2fc57d9b23be592027e0244d4b998baa.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F59%252Fb65989e50d721fdb029dfcc7548f7be7%252Fpa%252FUR96395_1a39d31c52656163f6fa4ff02f2bfbfa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_1a39d31c52656163f6fa4ff02f2bfbfa.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F59%252Fb65989e50d721fdb029dfcc7548f7be7%252Fpa%252FUR96395_c63b1af56bd329b0d26e689bbfbf41d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_c63b1af56bd329b0d26e689bbfbf41d4.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F59%252Fb65989e50d721fdb029dfcc7548f7be7%252Fpa%252FUR96395_281b2c006d707e65892a0bbeda19b390.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_281b2c006d707e65892a0bbeda19b390.jpg already downloaded
2026-03-27 20:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc31ab03-abfe-5ea7-8fa8-df70e9489f69, identifier: UR96395
2026-03-27 20:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-27 20:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb93a4ea-803b-569d-bc31-c83363dab30d with scrape type 1
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb93a4ea-803b-569d-bc31-c83363dab30d
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_7e0298d0650b2b610a4257d0bc9dfc1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_7e0298d0650b2b610a4257d0bc9dfc1e.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_e64e33a915da7e255ec914f7426d7314.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_e64e33a915da7e255ec914f7426d7314.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_4e4127123fc9217e847446ee93e5e4bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_4e4127123fc9217e847446ee93e5e4bc.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_baff830dfa57e4925c7ed698152afe66.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_baff830dfa57e4925c7ed698152afe66.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_cca4db523d4aed1e278a3663afa174cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_cca4db523d4aed1e278a3663afa174cc.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_6d0aab4bc49580b0279bf8fe7d065077.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_6d0aab4bc49580b0279bf8fe7d065077.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_d960942937c94f05c8dcf993e646b1d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_d960942937c94f05c8dcf993e646b1d1.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_c121165e5df5c58e8617db745c032b78.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_c121165e5df5c58e8617db745c032b78.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_27baa359296a9dc7ba12b161739b55dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_27baa359296a9dc7ba12b161739b55dd.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F46%252F0746fc8f334d6ca0e21e7965174d3c8d%252Fpa%252FYU69949_b7497765483d3aae9b846fae51728794.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_b7497765483d3aae9b846fae51728794.jpg already downloaded
2026-03-27 20:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb93a4ea-803b-569d-bc31-c83363dab30d, identifier: YU69949
2026-03-27 20:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-27 20:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with scrape type 1
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7805f9c5-0726-5cdf-9ffa-e191aefa6f47
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_a42823167a67727239a4f93e0c853649.png%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_a42823167a67727239a4f93e0c853649.png already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_c6a915ea59dec73ab9684fd3b65ea469.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_c6a915ea59dec73ab9684fd3b65ea469.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_1806dad56265a39c9cbea5629a56d730.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_1806dad56265a39c9cbea5629a56d730.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_b7fdbf71469bb632380e895963e5f018.png%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_b7fdbf71469bb632380e895963e5f018.png already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_d7b0bdf2aba19f63bed98d58426ef5c6.png%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_d7b0bdf2aba19f63bed98d58426ef5c6.png already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_28f41aece77912cbb75aa16e7fd3424d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_28f41aece77912cbb75aa16e7fd3424d.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_650922e565633596d4beacea563e25cb.png%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_650922e565633596d4beacea563e25cb.png already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_76a9b2d767a2d4989f07ddc66b2e8fcd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_76a9b2d767a2d4989f07ddc66b2e8fcd.jpg already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_1eaddb3ee3cadb58eac2d7ec5184b9ff.png%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_1eaddb3ee3cadb58eac2d7ec5184b9ff.png already downloaded
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313bafa9d79faa5273eabdd9b5dc59bf%252Fpa%252FHX42019_133f65c94f6dac29bdcecf8784ab96c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_133f65c94f6dac29bdcecf8784ab96c4.jpg already downloaded
2026-03-27 20:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47, identifier: HX42019
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-27 20:37:37 [auto1.be] INFO: Scrape type for HU58936: 1
2026-03-27 20:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-27 20:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-27 20:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395 to the API
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UR96395>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:22:26Z',
 'fuel_type': 'diesel',
 'id': 'bc31ab03-abfe-5ea7-8fa8-df70e9489f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR96395',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 109669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_7853c41f472cca08ee0907c18348ee6f.jpg',
                'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_ceca1be394326f63c99235f0b139fd88.jpg',
                'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_2fc57d9b23be592027e0244d4b998baa.jpg',
                'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_1a39d31c52656163f6fa4ff02f2bfbfa.jpg',
                'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_c63b1af56bd329b0d26e689bbfbf41d4.jpg',
                'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_281b2c006d707e65892a0bbeda19b390.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc31ab03-abfe-5ea7-8fa8-df70e9489f69/bc31ab03-abfe-5ea7-8fa8-df70e9489f69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_7853c41f472cca08ee0907c18348ee6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc31ab03-abfe-5ea7-8fa8-df70e9489f69/bc31ab03-abfe-5ea7-8fa8-df70e9489f69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_ceca1be394326f63c99235f0b139fd88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc31ab03-abfe-5ea7-8fa8-df70e9489f69/bc31ab03-abfe-5ea7-8fa8-df70e9489f69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_2fc57d9b23be592027e0244d4b998baa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc31ab03-abfe-5ea7-8fa8-df70e9489f69/bc31ab03-abfe-5ea7-8fa8-df70e9489f69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_1a39d31c52656163f6fa4ff02f2bfbfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc31ab03-abfe-5ea7-8fa8-df70e9489f69/bc31ab03-abfe-5ea7-8fa8-df70e9489f69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_c63b1af56bd329b0d26e689bbfbf41d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc31ab03-abfe-5ea7-8fa8-df70e9489f69/bc31ab03-abfe-5ea7-8fa8-df70e9489f69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/59/b65989e50d721fdb029dfcc7548f7be7/pa/UR96395_281b2c006d707e65892a0bbeda19b390.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-27 20:37:37 [auto1.be] INFO: Saving data for UR96395: {'created_time': 1774643857.348781, 'last_price_update_time': 1774643857.348792, 'auction_closing_time': 1774714946.0}
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR96395') HTTP/1.1" 204 0
2026-03-27 20:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-27 20:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-27 20:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949 to the API
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU69949>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'diesel',
 'id': 'fb93a4ea-803b-569d-bc31-c83363dab30d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU69949',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 70496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_7e0298d0650b2b610a4257d0bc9dfc1e.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_e64e33a915da7e255ec914f7426d7314.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_4e4127123fc9217e847446ee93e5e4bc.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_baff830dfa57e4925c7ed698152afe66.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_cca4db523d4aed1e278a3663afa174cc.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_6d0aab4bc49580b0279bf8fe7d065077.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_d960942937c94f05c8dcf993e646b1d1.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_c121165e5df5c58e8617db745c032b78.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_27baa359296a9dc7ba12b161739b55dd.jpg',
                'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_b7497765483d3aae9b846fae51728794.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_7e0298d0650b2b610a4257d0bc9dfc1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_e64e33a915da7e255ec914f7426d7314.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_4e4127123fc9217e847446ee93e5e4bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_baff830dfa57e4925c7ed698152afe66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_cca4db523d4aed1e278a3663afa174cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_6d0aab4bc49580b0279bf8fe7d065077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_d960942937c94f05c8dcf993e646b1d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_c121165e5df5c58e8617db745c032b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_27baa359296a9dc7ba12b161739b55dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb93a4ea-803b-569d-bc31-c83363dab30d/fb93a4ea-803b-569d-bc31-c83363dab30d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/46/0746fc8f334d6ca0e21e7965174d3c8d/pa/YU69949_b7497765483d3aae9b846fae51728794.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-27 20:37:37 [auto1.be] INFO: Saving data for YU69949: {'created_time': 1774643857.676458, 'last_price_update_time': 1774643857.676469, 'auction_closing_time': 1774716349.0}
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU69949') HTTP/1.1" 204 0
2026-03-27 20:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-27 20:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019
2026-03-27 20:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7805f9c5-0726-5cdf-9ffa-e191aefa6f47 with identifier: HX42019 to the API
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HX42019>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:35:44Z',
 'fuel_type': 'petrol',
 'id': '7805f9c5-0726-5cdf-9ffa-e191aefa6f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX42019',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 16623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_a42823167a67727239a4f93e0c853649.png',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_c6a915ea59dec73ab9684fd3b65ea469.jpg',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_1806dad56265a39c9cbea5629a56d730.jpg',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_b7fdbf71469bb632380e895963e5f018.png',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_d7b0bdf2aba19f63bed98d58426ef5c6.png',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_28f41aece77912cbb75aa16e7fd3424d.jpg',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_650922e565633596d4beacea563e25cb.png',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_76a9b2d767a2d4989f07ddc66b2e8fcd.jpg',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_1eaddb3ee3cadb58eac2d7ec5184b9ff.png',
                'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_133f65c94f6dac29bdcecf8784ab96c4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 261725,
             'Height': 473,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_a42823167a67727239a4f93e0c853649.png',
             'Width': 635},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 14066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_c6a915ea59dec73ab9684fd3b65ea469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 14066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_1806dad56265a39c9cbea5629a56d730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 223079,
             'Height': 472,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_b7fdbf71469bb632380e895963e5f018.png',
             'Width': 622},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 263424,
             'Height': 468,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_d7b0bdf2aba19f63bed98d58426ef5c6.png',
             'Width': 625},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 14066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_28f41aece77912cbb75aa16e7fd3424d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 225774,
             'Height': 472,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_650922e565633596d4beacea563e25cb.png',
             'Width': 624},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 14066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_76a9b2d767a2d4989f07ddc66b2e8fcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_8.png',
             'Extension': 'png',
             'FileSizeInBytes': 583952,
             'Height': 471,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_1eaddb3ee3cadb58eac2d7ec5184b9ff.png',
             'Width': 629},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7805f9c5-0726-5cdf-9ffa-e191aefa6f47/7805f9c5-0726-5cdf-9ffa-e191aefa6f47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 14066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313bafa9d79faa5273eabdd9b5dc59bf/pa/HX42019_133f65c94f6dac29bdcecf8784ab96c4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2024}
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-27 20:37:37 [auto1.be] INFO: Saving data for HX42019: {'created_time': 1774643857.9698, 'last_price_update_time': 1774643857.969811, 'auction_closing_time': 1774715744.0}
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX42019') HTTP/1.1" 204 0
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-27 20:37:37 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [auto1.be] INFO: Scrape type for NU98421: 1
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-27 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM98751> (referer: https://www.auto1.com/v1/car-details-view/ZM98751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED46000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK56681%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [auto1.be] INFO: Scrape type for PK56681: 1
2026-03-27 20:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [auto1.be] INFO: Scrape type for VE25219: 2
2026-03-27 20:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-27 20:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc247f5-8245-5670-8396-d87c43561ad5 with scrape type 2
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc247f5-8245-5670-8396-d87c43561ad5 with scrape type 2
2026-03-27 20:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3cc247f5-8245-5670-8396-d87c43561ad5, identifier: VE25219
2026-03-27 20:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-27 20:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-27 20:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219 to the API
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:46Z',
 'fuel_type': 'petrol',
 'id': '3cc247f5-8245-5670-8396-d87c43561ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE25219',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 55598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-31',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [auto1.be] INFO: Saving data for VE25219: {'auction_closing_time': 1774714726.0, 'created_time': 1773239663.19014, 'last_price_update_time': 1774643858.423051}
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE25219') HTTP/1.1" 204 0
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW39031%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [auto1.be] INFO: Scrape type for BW39031: 1
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [auto1.be] INFO: Scrape type for UF59925: 1
2026-03-27 20:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc3594b3-1625-5fc6-8dac-545d4ae55f43 with identifier: ZM98751
2026-03-27 20:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc3594b3-1625-5fc6-8dac-545d4ae55f43 with scrape type 1
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc3594b3-1625-5fc6-8dac-545d4ae55f43
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_a64cf8f46497f8434a0359665693aaa4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_a64cf8f46497f8434a0359665693aaa4.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_4bec0eeb6211e875fc4eb37606d83f5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_4bec0eeb6211e875fc4eb37606d83f5b.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_579383cb91d67ca96e05af92246efd60.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_579383cb91d67ca96e05af92246efd60.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_f17562de8722be7528f45567beec7963.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_f17562de8722be7528f45567beec7963.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_d0fb94246c888e194a1bf149230a640d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_d0fb94246c888e194a1bf149230a640d.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_ee32d6721c87a77836abfa68ba0a6c9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_ee32d6721c87a77836abfa68ba0a6c9c.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_e812606c1b5dd0b6232635df94bb66f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_e812606c1b5dd0b6232635df94bb66f3.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_a2b5fa639c46c2774c2dbfaa5e3a7270.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_a2b5fa639c46c2774c2dbfaa5e3a7270.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_d3f66cae9e3445e6f1672b924357d1f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_d3f66cae9e3445e6f1672b924357d1f3.jpg already downloaded
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F39%252F7739d56d627d2199507d64235af21626%252Fpa%252FZM98751_8b5f4975595f3335ba2086bafa719b06.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_8b5f4975595f3335ba2086bafa719b06.jpg already downloaded
2026-03-27 20:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc3594b3-1625-5fc6-8dac-545d4ae55f43, identifier: ZM98751
2026-03-27 20:37:38 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-27 20:37:38 [auto1.be] INFO: Scrape type for TC19196: 1
2026-03-27 20:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc3594b3-1625-5fc6-8dac-545d4ae55f43 with identifier: ZM98751
2026-03-27 20:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc3594b3-1625-5fc6-8dac-545d4ae55f43 with identifier: ZM98751
2026-03-27 20:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc3594b3-1625-5fc6-8dac-545d4ae55f43 with identifier: ZM98751 to the API
2026-03-27 20:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM98751>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:09:20Z',
 'fuel_type': 'diesel',
 'id': 'dc3594b3-1625-5fc6-8dac-545d4ae55f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM98751',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 117696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_a64cf8f46497f8434a0359665693aaa4.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_4bec0eeb6211e875fc4eb37606d83f5b.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_579383cb91d67ca96e05af92246efd60.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_f17562de8722be7528f45567beec7963.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_d0fb94246c888e194a1bf149230a640d.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_ee32d6721c87a77836abfa68ba0a6c9c.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_e812606c1b5dd0b6232635df94bb66f3.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_a2b5fa639c46c2774c2dbfaa5e3a7270.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_d3f66cae9e3445e6f1672b924357d1f3.jpg',
                'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_8b5f4975595f3335ba2086bafa719b06.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_a64cf8f46497f8434a0359665693aaa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_4bec0eeb6211e875fc4eb37606d83f5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_579383cb91d67ca96e05af92246efd60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_f17562de8722be7528f45567beec7963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_d0fb94246c888e194a1bf149230a640d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_ee32d6721c87a77836abfa68ba0a6c9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_e812606c1b5dd0b6232635df94bb66f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_a2b5fa639c46c2774c2dbfaa5e3a7270.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_d3f66cae9e3445e6f1672b924357d1f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc3594b3-1625-5fc6-8dac-545d4ae55f43/dc3594b3-1625-5fc6-8dac-545d4ae55f43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/39/7739d56d627d2199507d64235af21626/pa/ZM98751_8b5f4975595f3335ba2086bafa719b06.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Opel 2020 Start/Stop',
 'transmission': 'manual',
 'trim': '2020 Start/Stop',
 'year': 2020}
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM98751%27 HTTP/1.1" 200 None
2026-03-27 20:37:39 [auto1.be] INFO: Saving data for ZM98751: {'created_time': 1774643859.172281, 'last_price_update_time': 1774643859.172293, 'auction_closing_time': 1774714160.0}
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM98751') HTTP/1.1" 204 0
2026-03-27 20:37:39 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-27 20:37:39 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-27 20:37:39 [auto1.be] INFO: Scrape type for ET18736: 1
2026-03-27 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ61910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV41613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ17204> (referer: https://www.auto1.com/v1/car-details-view/XJ17204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:39 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-27 20:37:39 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF15536%27 HTTP/1.1" 200 None
2026-03-27 20:37:39 [auto1.be] INFO: Scrape type for BF15536: 2
2026-03-27 20:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00d02d93-92ab-5b71-9f82-a0e651030025 with identifier: BF15536
2026-03-27 20:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00d02d93-92ab-5b71-9f82-a0e651030025 with scrape type 2
2026-03-27 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00d02d93-92ab-5b71-9f82-a0e651030025 with scrape type 2
2026-03-27 20:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00d02d93-92ab-5b71-9f82-a0e651030025, identifier: BF15536
2026-03-27 20:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00d02d93-92ab-5b71-9f82-a0e651030025 with identifier: BF15536
2026-03-27 20:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00d02d93-92ab-5b71-9f82-a0e651030025 with identifier: BF15536
2026-03-27 20:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00d02d93-92ab-5b71-9f82-a0e651030025 with identifier: BF15536 to the API
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:15:46Z',
 'fuel_type': 'diesel',
 'id': '00d02d93-92ab-5b71-9f82-a0e651030025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF15536',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Cascada',
 'odometer': 100718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Opel Cascada 2.0 CDTI Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF15536%27 HTTP/1.1" 200 None
2026-03-27 20:37:39 [auto1.be] INFO: Saving data for BF15536: {'auction_closing_time': 1774714546.0, 'created_time': 1773240749.83812, 'last_price_update_time': 1774643859.636558}
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BF15536') HTTP/1.1" 204 0
2026-03-27 20:37:39 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC04988%27 HTTP/1.1" 200 None
2026-03-27 20:37:39 [auto1.be] INFO: Scrape type for PC04988: 2
2026-03-27 20:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e1eb23-af07-5159-92b9-4b24d2a1b66a with identifier: PC04988
2026-03-27 20:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e1eb23-af07-5159-92b9-4b24d2a1b66a with scrape type 2
2026-03-27 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63e1eb23-af07-5159-92b9-4b24d2a1b66a with scrape type 2
2026-03-27 20:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63e1eb23-af07-5159-92b9-4b24d2a1b66a, identifier: PC04988
2026-03-27 20:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63e1eb23-af07-5159-92b9-4b24d2a1b66a with identifier: PC04988
2026-03-27 20:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63e1eb23-af07-5159-92b9-4b24d2a1b66a with identifier: PC04988
2026-03-27 20:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63e1eb23-af07-5159-92b9-4b24d2a1b66a with identifier: PC04988 to the API
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'diesel',
 'id': '63e1eb23-af07-5159-92b9-4b24d2a1b66a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC04988',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 113502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Portfolio AWD',
 'transmission': 'automatic',
 'trim': 'Portfolio AWD',
 'year': 2017}
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC04988%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [auto1.be] INFO: Saving data for PC04988: {'auction_closing_time': 1774716565.0, 'created_time': 1773136952.798165, 'last_price_update_time': 1774643860.045146}
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC04988') HTTP/1.1" 204 0
2026-03-27 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU29895> (referer: https://www.auto1.com/v1/car-details-view/YU29895/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:40 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-27 20:37:40 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [auto1.be] INFO: Scrape type for BD95571: 2
2026-03-27 20:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-27 20:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with scrape type 2
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with scrape type 2
2026-03-27 20:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb9e4e0-3076-56c9-a209-f06e6b24a6d9, identifier: BD95571
2026-03-27 20:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-27 20:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-27 20:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571 to the API
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:11Z',
 'fuel_type': 'petrol',
 'id': 'efb9e4e0-3076-56c9-a209-f06e6b24a6d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD95571',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 35981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [auto1.be] INFO: Saving data for BD95571: {'auction_closing_time': 1774713611.0, 'created_time': 1773136854.979983, 'last_price_update_time': 1774643860.436866}
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD95571') HTTP/1.1" 204 0
2026-03-27 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM47736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ27182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d481f57-4658-5f39-b50b-a8138fca08f0 with identifier: XJ17204
2026-03-27 20:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d481f57-4658-5f39-b50b-a8138fca08f0 with scrape type 1
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d481f57-4658-5f39-b50b-a8138fca08f0
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_38b953ef42ba11610e4e39d7d89b5e7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_38b953ef42ba11610e4e39d7d89b5e7c.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_23ef7c4281334671cb1705bab193dc4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_23ef7c4281334671cb1705bab193dc4a.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_c30cfca296556680d7c8fcb5d5547dd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_c30cfca296556680d7c8fcb5d5547dd4.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_1b497eaa5e78c5aa12f951a9e1c46a15.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_1b497eaa5e78c5aa12f951a9e1c46a15.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_0b325f0dff6abb2d13f0cea97af3b6a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_0b325f0dff6abb2d13f0cea97af3b6a3.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_cd431e9e6ebdf0862d6b998993b4a819.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_cd431e9e6ebdf0862d6b998993b4a819.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_ef510941fdf24c36876ee40d42893b42.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_ef510941fdf24c36876ee40d42893b42.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_2fe42f0c04e70d21a48d4e12feee89b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_2fe42f0c04e70d21a48d4e12feee89b2.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_0fb6cf3a3b797eefd716fc0bc3ca9992.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_0fb6cf3a3b797eefd716fc0bc3ca9992.jpg already downloaded
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F4b%252F174b81897222fe9b2cccf6d5c9568239%252Fpa%252FXJ17204_65a9e66ecf696f9eecf85dffc7314b58.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_65a9e66ecf696f9eecf85dffc7314b58.jpg already downloaded
2026-03-27 20:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d481f57-4658-5f39-b50b-a8138fca08f0, identifier: XJ17204
2026-03-27 20:37:40 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-27 20:37:40 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-27 20:37:40 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY14348%27 HTTP/1.1" 200 None
2026-03-27 20:37:40 [auto1.be] INFO: Scrape type for HY14348: 2
2026-03-27 20:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b9155ff-41dc-56ee-83bd-bc8332814fbc with identifier: HY14348
2026-03-27 20:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9155ff-41dc-56ee-83bd-bc8332814fbc with scrape type 2
2026-03-27 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b9155ff-41dc-56ee-83bd-bc8332814fbc with scrape type 2
2026-03-27 20:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b9155ff-41dc-56ee-83bd-bc8332814fbc, identifier: HY14348
2026-03-27 20:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d481f57-4658-5f39-b50b-a8138fca08f0 with identifier: XJ17204
2026-03-27 20:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d481f57-4658-5f39-b50b-a8138fca08f0 with identifier: XJ17204
2026-03-27 20:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d481f57-4658-5f39-b50b-a8138fca08f0 with identifier: XJ17204 to the API
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XJ17204>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:18:49Z',
 'fuel_type': 'diesel',
 'id': '8d481f57-4658-5f39-b50b-a8138fca08f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ17204',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 58844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photo_urls': ['https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_38b953ef42ba11610e4e39d7d89b5e7c.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_23ef7c4281334671cb1705bab193dc4a.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_c30cfca296556680d7c8fcb5d5547dd4.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_1b497eaa5e78c5aa12f951a9e1c46a15.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_0b325f0dff6abb2d13f0cea97af3b6a3.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_cd431e9e6ebdf0862d6b998993b4a819.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_ef510941fdf24c36876ee40d42893b42.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_2fe42f0c04e70d21a48d4e12feee89b2.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_0fb6cf3a3b797eefd716fc0bc3ca9992.jpg',
                'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_65a9e66ecf696f9eecf85dffc7314b58.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3864098,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_38b953ef42ba11610e4e39d7d89b5e7c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_23ef7c4281334671cb1705bab193dc4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_c30cfca296556680d7c8fcb5d5547dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_1b497eaa5e78c5aa12f951a9e1c46a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_0b325f0dff6abb2d13f0cea97af3b6a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_cd431e9e6ebdf0862d6b998993b4a819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_ef510941fdf24c36876ee40d42893b42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_2fe42f0c04e70d21a48d4e12feee89b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_0fb6cf3a3b797eefd716fc0bc3ca9992.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d481f57-4658-5f39-b50b-a8138fca08f0/8d481f57-4658-5f39-b50b-a8138fca08f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/4b/174b81897222fe9b2cccf6d5c9568239/pa/XJ17204_65a9e66ecf696f9eecf85dffc7314b58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'automatic',
 'trim': 'Feel M',
 'year': 2020}
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ17204%27 HTTP/1.1" 200 None
2026-03-27 20:37:41 [auto1.be] INFO: Saving data for XJ17204: {'created_time': 1774643861.260813, 'last_price_update_time': 1774643861.260824, 'auction_closing_time': 1774714729.0}
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ17204') HTTP/1.1" 204 0
2026-03-27 20:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b9155ff-41dc-56ee-83bd-bc8332814fbc with identifier: HY14348
2026-03-27 20:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b9155ff-41dc-56ee-83bd-bc8332814fbc with identifier: HY14348
2026-03-27 20:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b9155ff-41dc-56ee-83bd-bc8332814fbc with identifier: HY14348 to the API
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:10:40Z',
 'fuel_type': 'diesel',
 'id': '2b9155ff-41dc-56ee-83bd-bc8332814fbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY14348',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 253664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2016}
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY14348%27 HTTP/1.1" 200 None
2026-03-27 20:37:41 [auto1.be] INFO: Saving data for HY14348: {'auction_closing_time': 1774714240.0, 'created_time': 1773136213.809636, 'last_price_update_time': 1774643861.553269}
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY14348') HTTP/1.1" 204 0
2026-03-27 20:37:41 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-27 20:37:41 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-27 20:37:41 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU52750%27 HTTP/1.1" 200 None
2026-03-27 20:37:41 [auto1.be] INFO: Scrape type for UU52750: 2
2026-03-27 20:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb30c5d1-3368-5771-a91a-b65ded842f67 with identifier: UU52750
2026-03-27 20:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb30c5d1-3368-5771-a91a-b65ded842f67 with scrape type 2
2026-03-27 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb30c5d1-3368-5771-a91a-b65ded842f67 with scrape type 2
2026-03-27 20:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb30c5d1-3368-5771-a91a-b65ded842f67, identifier: UU52750
2026-03-27 20:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC47788> (referer: https://www.auto1.com/v1/car-details-view/PC47788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb30c5d1-3368-5771-a91a-b65ded842f67 with identifier: UU52750
2026-03-27 20:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb30c5d1-3368-5771-a91a-b65ded842f67 with identifier: UU52750
2026-03-27 20:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb30c5d1-3368-5771-a91a-b65ded842f67 with identifier: UU52750 to the API
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:45:37Z',
 'fuel_type': 'diesel',
 'id': 'bb30c5d1-3368-5771-a91a-b65ded842f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU52750',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 85535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2021}
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU52750%27 HTTP/1.1" 200 None
2026-03-27 20:37:41 [auto1.be] INFO: Saving data for UU52750: {'auction_closing_time': 1774716337.0, 'created_time': 1773133513.83536, 'last_price_update_time': 1774643861.942019}
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU52750') HTTP/1.1" 204 0
2026-03-27 20:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cfde910-7a01-5c98-baf0-358c7c68d711 with identifier: YU29895
2026-03-27 20:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cfde910-7a01-5c98-baf0-358c7c68d711 with scrape type 1
2026-03-27 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9cfde910-7a01-5c98-baf0-358c7c68d711
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_6bfe0fb87031202ff470b9baca7ecfb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_6bfe0fb87031202ff470b9baca7ecfb3.jpg already downloaded
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_dc95aff80483ed33755f0212bc92dae4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_dc95aff80483ed33755f0212bc92dae4.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_39a4686c2e494aef8b233510ec64f383.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_39a4686c2e494aef8b233510ec64f383.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_571b06f2f3db4a774144e8faa9f68aae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_571b06f2f3db4a774144e8faa9f68aae.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_565953d950faeb8761b97a71e94a41c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_565953d950faeb8761b97a71e94a41c8.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_e929f31010e0e7c3fde227e37b2d4237.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_e929f31010e0e7c3fde227e37b2d4237.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_628e6c518e6696c9bf5b7d05959256cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_628e6c518e6696c9bf5b7d05959256cc.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_ceafde2003a872dface9e12557448e85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_ceafde2003a872dface9e12557448e85.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_abefee5c0a628481b28efbc64cde0233.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_abefee5c0a628481b28efbc64cde0233.jpg already downloaded
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Ff5%252F11f52e6fae6bda0f22fbacc18799bc43%252Fpa%252FYU29895_c9ae38ad6628e5380d7193f825870619.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_c9ae38ad6628e5380d7193f825870619.jpg already downloaded
2026-03-27 20:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9cfde910-7a01-5c98-baf0-358c7c68d711, identifier: YU29895
2026-03-27 20:37:42 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-27 20:37:42 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE95300%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [auto1.be] INFO: Scrape type for GE95300: 2
2026-03-27 20:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d98675-74eb-5447-bed5-d1fc70a51561 with identifier: GE95300
2026-03-27 20:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d98675-74eb-5447-bed5-d1fc70a51561 with scrape type 2
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d98675-74eb-5447-bed5-d1fc70a51561 with scrape type 2
2026-03-27 20:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66d98675-74eb-5447-bed5-d1fc70a51561, identifier: GE95300
2026-03-27 20:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9cfde910-7a01-5c98-baf0-358c7c68d711 with identifier: YU29895
2026-03-27 20:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9cfde910-7a01-5c98-baf0-358c7c68d711 with identifier: YU29895
2026-03-27 20:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9cfde910-7a01-5c98-baf0-358c7c68d711 with identifier: YU29895 to the API
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU29895>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:56:38Z',
 'fuel_type': 'petrol',
 'id': '9cfde910-7a01-5c98-baf0-358c7c68d711',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU29895',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 68425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_6bfe0fb87031202ff470b9baca7ecfb3.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_dc95aff80483ed33755f0212bc92dae4.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_39a4686c2e494aef8b233510ec64f383.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_571b06f2f3db4a774144e8faa9f68aae.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_565953d950faeb8761b97a71e94a41c8.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_e929f31010e0e7c3fde227e37b2d4237.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_628e6c518e6696c9bf5b7d05959256cc.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_ceafde2003a872dface9e12557448e85.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_abefee5c0a628481b28efbc64cde0233.jpg',
                'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_c9ae38ad6628e5380d7193f825870619.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_6bfe0fb87031202ff470b9baca7ecfb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_dc95aff80483ed33755f0212bc92dae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_39a4686c2e494aef8b233510ec64f383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_571b06f2f3db4a774144e8faa9f68aae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_565953d950faeb8761b97a71e94a41c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_e929f31010e0e7c3fde227e37b2d4237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_628e6c518e6696c9bf5b7d05959256cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_ceafde2003a872dface9e12557448e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_abefee5c0a628481b28efbc64cde0233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cfde910-7a01-5c98-baf0-358c7c68d711/9cfde910-7a01-5c98-baf0-358c7c68d711_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/f5/11f52e6fae6bda0f22fbacc18799bc43/pa/YU29895_c9ae38ad6628e5380d7193f825870619.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2017}
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU29895%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [auto1.be] INFO: Saving data for YU29895: {'created_time': 1774643862.608647, 'last_price_update_time': 1774643862.608656, 'auction_closing_time': 1774716998.0}
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU29895') HTTP/1.1" 204 0
2026-03-27 20:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66d98675-74eb-5447-bed5-d1fc70a51561 with identifier: GE95300
2026-03-27 20:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66d98675-74eb-5447-bed5-d1fc70a51561 with identifier: GE95300
2026-03-27 20:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66d98675-74eb-5447-bed5-d1fc70a51561 with identifier: GE95300 to the API
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'diesel',
 'id': '66d98675-74eb-5447-bed5-d1fc70a51561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE95300',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 92868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI RWD lang',
 'transmission': 'automatic',
 'trim': 'RWD lang',
 'year': 2020}
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE95300%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [auto1.be] INFO: Saving data for GE95300: {'auction_closing_time': 1774716320.0, 'created_time': 1774298199.013165, 'last_price_update_time': 1774643862.908741}
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GE95300') HTTP/1.1" 204 0
2026-03-27 20:37:42 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-27 20:37:42 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN79579%27 HTTP/1.1" 200 None
2026-03-27 20:37:42 [auto1.be] INFO: Scrape type for XN79579: 2
2026-03-27 20:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea71b65-9d06-5c85-a359-af9396b9a58b with identifier: XN79579
2026-03-27 20:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea71b65-9d06-5c85-a359-af9396b9a58b with scrape type 2
2026-03-27 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea71b65-9d06-5c85-a359-af9396b9a58b with scrape type 2
2026-03-27 20:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ea71b65-9d06-5c85-a359-af9396b9a58b, identifier: XN79579
2026-03-27 20:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ea71b65-9d06-5c85-a359-af9396b9a58b with identifier: XN79579
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 20:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ea71b65-9d06-5c85-a359-af9396b9a58b with identifier: XN79579
2026-03-27 20:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ea71b65-9d06-5c85-a359-af9396b9a58b with identifier: XN79579 to the API
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:47:50Z',
 'fuel_type': 'petrol',
 'id': '0ea71b65-9d06-5c85-a359-af9396b9a58b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN79579',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 169010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN79579%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [auto1.be] INFO: Saving data for XN79579: {'auction_closing_time': 1774716470.0, 'created_time': 1773135275.325408, 'last_price_update_time': 1774643863.439559}
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN79579') HTTP/1.1" 204 0
2026-03-27 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV56621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK22486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae942d80-8734-5814-bda5-d6cdd2ae21f6 with identifier: PC47788
2026-03-27 20:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae942d80-8734-5814-bda5-d6cdd2ae21f6 with scrape type 1
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae942d80-8734-5814-bda5-d6cdd2ae21f6
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_45ab343993e37bc671b891bed342f7ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_45ab343993e37bc671b891bed342f7ae.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_32eb9783e6fdb2817549b15e4695d9aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_32eb9783e6fdb2817549b15e4695d9aa.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_3fa4dd011379c34d6d7bcda57dd066a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_3fa4dd011379c34d6d7bcda57dd066a1.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_19c25f069bb52f20eeb05602c21c3468.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_19c25f069bb52f20eeb05602c21c3468.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_e9d5b983e7b399a7e50009ecc38ed233.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_e9d5b983e7b399a7e50009ecc38ed233.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_bbbc378a78bcbf98d62b0e429981bbbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_bbbc378a78bcbf98d62b0e429981bbbd.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_75f840a10a67fbbc77b832f07d0812d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_75f840a10a67fbbc77b832f07d0812d1.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_a89579e97fcc452d82abe797725e67a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_a89579e97fcc452d82abe797725e67a6.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_3a7b14966b7c9bb4ae79621130559a5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_3a7b14966b7c9bb4ae79621130559a5f.jpg already downloaded
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F90%252F17900f0c5f7dda4a4134046d2a8fe917%252Fpa%252FPC47788_44171491f9336c62f7d88237d3f01256.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_44171491f9336c62f7d88237d3f01256.jpg already downloaded
2026-03-27 20:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ae942d80-8734-5814-bda5-d6cdd2ae21f6, identifier: PC47788
2026-03-27 20:37:43 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-27 20:37:43 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-27 20:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ae942d80-8734-5814-bda5-d6cdd2ae21f6 with identifier: PC47788
2026-03-27 20:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ae942d80-8734-5814-bda5-d6cdd2ae21f6 with identifier: PC47788
2026-03-27 20:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ae942d80-8734-5814-bda5-d6cdd2ae21f6 with identifier: PC47788 to the API
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC47788>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:17:45Z',
 'fuel_type': 'diesel',
 'id': 'ae942d80-8734-5814-bda5-d6cdd2ae21f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC47788',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'BMW',
 'model': '3er',
 'odometer': 202683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_45ab343993e37bc671b891bed342f7ae.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_32eb9783e6fdb2817549b15e4695d9aa.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_3fa4dd011379c34d6d7bcda57dd066a1.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_19c25f069bb52f20eeb05602c21c3468.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_e9d5b983e7b399a7e50009ecc38ed233.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_bbbc378a78bcbf98d62b0e429981bbbd.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_75f840a10a67fbbc77b832f07d0812d1.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_a89579e97fcc452d82abe797725e67a6.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_3a7b14966b7c9bb4ae79621130559a5f.jpg',
                'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_44171491f9336c62f7d88237d3f01256.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_45ab343993e37bc671b891bed342f7ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_32eb9783e6fdb2817549b15e4695d9aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_3fa4dd011379c34d6d7bcda57dd066a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_19c25f069bb52f20eeb05602c21c3468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_e9d5b983e7b399a7e50009ecc38ed233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_bbbc378a78bcbf98d62b0e429981bbbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_75f840a10a67fbbc77b832f07d0812d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_a89579e97fcc452d82abe797725e67a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_3a7b14966b7c9bb4ae79621130559a5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae942d80-8734-5814-bda5-d6cdd2ae21f6/ae942d80-8734-5814-bda5-d6cdd2ae21f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/90/17900f0c5f7dda4a4134046d2a8fe917/pa/PC47788_44171491f9336c62f7d88237d3f01256.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d GT',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC47788%27 HTTP/1.1" 200 None
2026-03-27 20:37:44 [auto1.be] INFO: Saving data for PC47788: {'created_time': 1774643864.023445, 'last_price_update_time': 1774643864.023456, 'auction_closing_time': 1774714665.0}
2026-03-27 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC47788') HTTP/1.1" 204 0
2026-03-27 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM54686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD77902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU58936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU98421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC19196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED46000> (referer: https://www.auto1.com/v1/car-details-view/ED46000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG12074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF59925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0233723-6482-556b-a120-804575d0ed36 with identifier: ED46000
2026-03-27 20:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0233723-6482-556b-a120-804575d0ed36 with scrape type 1
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0233723-6482-556b-a120-804575d0ed36
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_4d4cf0b30058db0c7d9dfb4d1f912cae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_4d4cf0b30058db0c7d9dfb4d1f912cae.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_ad28496f10bb96a77fa8ca3ba3fb6aea.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_ad28496f10bb96a77fa8ca3ba3fb6aea.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_d776a801e5c9c51a29831984295c57c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_d776a801e5c9c51a29831984295c57c9.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_0eddeed7317088bfc37305c13e0f0334.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_0eddeed7317088bfc37305c13e0f0334.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_248d53549807646e2579b6e230dd3e67.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_248d53549807646e2579b6e230dd3e67.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_47ac8a1f47fa23621cc1186d8df3a7fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_47ac8a1f47fa23621cc1186d8df3a7fa.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_b9dee9b63967e18be042f08f41408e29.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_b9dee9b63967e18be042f08f41408e29.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_90aa95861a843e6e3cd732c99500813f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_90aa95861a843e6e3cd732c99500813f.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_1c8873f32afbecd624e8516a534ccc7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_1c8873f32afbecd624e8516a534ccc7a.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F26%252Fea26db82e7159d27fbe3faeb90a31381%252Fpa%252FED46000_c2688b0c14770c719fb4ceaa927f4a19.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_c2688b0c14770c719fb4ceaa927f4a19.jpg already downloaded
2026-03-27 20:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0233723-6482-556b-a120-804575d0ed36, identifier: ED46000
2026-03-27 20:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0233723-6482-556b-a120-804575d0ed36 with identifier: ED46000
2026-03-27 20:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0233723-6482-556b-a120-804575d0ed36 with identifier: ED46000
2026-03-27 20:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0233723-6482-556b-a120-804575d0ed36 with identifier: ED46000 to the API
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED46000>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:44:01Z',
 'fuel_type': 'petrol',
 'id': 'f0233723-6482-556b-a120-804575d0ed36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED46000',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 45537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_4d4cf0b30058db0c7d9dfb4d1f912cae.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_ad28496f10bb96a77fa8ca3ba3fb6aea.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_d776a801e5c9c51a29831984295c57c9.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_0eddeed7317088bfc37305c13e0f0334.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_248d53549807646e2579b6e230dd3e67.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_47ac8a1f47fa23621cc1186d8df3a7fa.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_b9dee9b63967e18be042f08f41408e29.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_90aa95861a843e6e3cd732c99500813f.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_1c8873f32afbecd624e8516a534ccc7a.jpg',
                'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_c2688b0c14770c719fb4ceaa927f4a19.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_4d4cf0b30058db0c7d9dfb4d1f912cae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_ad28496f10bb96a77fa8ca3ba3fb6aea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_d776a801e5c9c51a29831984295c57c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_0eddeed7317088bfc37305c13e0f0334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_248d53549807646e2579b6e230dd3e67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_47ac8a1f47fa23621cc1186d8df3a7fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_b9dee9b63967e18be042f08f41408e29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_90aa95861a843e6e3cd732c99500813f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_1c8873f32afbecd624e8516a534ccc7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0233723-6482-556b-a120-804575d0ed36/f0233723-6482-556b-a120-804575d0ed36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/26/ea26db82e7159d27fbe3faeb90a31381/pa/ED46000_c2688b0c14770c719fb4ceaa927f4a19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2023}
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED46000%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [auto1.be] INFO: Saving data for ED46000: {'created_time': 1774643865.647922, 'last_price_update_time': 1774643865.647955, 'auction_closing_time': 1774716241.0}
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED46000') HTTP/1.1" 204 0
2026-03-27 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX95723> (referer: https://www.auto1.com/v1/car-details-view/JX95723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB59400> (referer: https://www.auto1.com/v1/car-details-view/UB59400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET18736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31cc9e0e-9878-593c-aedf-fc0b5fab188b with identifier: JX95723
2026-03-27 20:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b with scrape type 1
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_e9b2d4e706a169698fdc5345502c39a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e9b2d4e706a169698fdc5345502c39a5.jpg not downloaded yet
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_f0642aca33378e63e28dff0a44f5d770.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_f0642aca33378e63e28dff0a44f5d770.jpg not downloaded yet
2026-03-27 20:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ed04793-26ef-5024-ac0f-f229e9383905 with identifier: UB59400
2026-03-27 20:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ed04793-26ef-5024-ac0f-f229e9383905 with scrape type 1
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ed04793-26ef-5024-ac0f-f229e9383905
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_a1f2d6f144107c26be8e00d081a71183.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_a1f2d6f144107c26be8e00d081a71183.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_419f5aff7942617166d32264abb57ca6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_419f5aff7942617166d32264abb57ca6.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_a9d28e60cb27b138a619090f1ee4de6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_a9d28e60cb27b138a619090f1ee4de6f.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_bb283aac56069bd7279d45f87a5ef14f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_bb283aac56069bd7279d45f87a5ef14f.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_5883bac9f9cedd9ca77a37a9c83d6acc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_5883bac9f9cedd9ca77a37a9c83d6acc.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_9cb6e8294b20465c67d63f7798069fdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_9cb6e8294b20465c67d63f7798069fdd.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_8f6b8f654b48b5f4c64ca38522753dc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_8f6b8f654b48b5f4c64ca38522753dc7.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_ff2900a53e0367783872bc84ade09a3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_ff2900a53e0367783872bc84ade09a3a.jpg already downloaded
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_7a583f15df48a970422a3f654dac2e32.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_7a583f15df48a970422a3f654dac2e32.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F71%252Fc7716a8527118a787853a6a09fd63627%252Fpa%252FUB59400_4d69cf5af1c4bc4a0601eb04fdfdafe4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_4d69cf5af1c4bc4a0601eb04fdfdafe4.jpg already downloaded
2026-03-27 20:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ed04793-26ef-5024-ac0f-f229e9383905, identifier: UB59400
2026-03-27 20:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ed04793-26ef-5024-ac0f-f229e9383905 with identifier: UB59400
2026-03-27 20:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ed04793-26ef-5024-ac0f-f229e9383905 with identifier: UB59400
2026-03-27 20:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ed04793-26ef-5024-ac0f-f229e9383905 with identifier: UB59400 to the API
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB59400>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:27:02Z',
 'fuel_type': 'petrol',
 'id': '2ed04793-26ef-5024-ac0f-f229e9383905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB59400',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 74464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_a1f2d6f144107c26be8e00d081a71183.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_419f5aff7942617166d32264abb57ca6.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_a9d28e60cb27b138a619090f1ee4de6f.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_bb283aac56069bd7279d45f87a5ef14f.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_5883bac9f9cedd9ca77a37a9c83d6acc.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_9cb6e8294b20465c67d63f7798069fdd.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_8f6b8f654b48b5f4c64ca38522753dc7.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_ff2900a53e0367783872bc84ade09a3a.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_7a583f15df48a970422a3f654dac2e32.jpg',
                'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_4d69cf5af1c4bc4a0601eb04fdfdafe4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_a1f2d6f144107c26be8e00d081a71183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_419f5aff7942617166d32264abb57ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_a9d28e60cb27b138a619090f1ee4de6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_bb283aac56069bd7279d45f87a5ef14f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_5883bac9f9cedd9ca77a37a9c83d6acc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_9cb6e8294b20465c67d63f7798069fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_8f6b8f654b48b5f4c64ca38522753dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_ff2900a53e0367783872bc84ade09a3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_7a583f15df48a970422a3f654dac2e32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ed04793-26ef-5024-ac0f-f229e9383905/2ed04793-26ef-5024-ac0f-f229e9383905_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/71/c7716a8527118a787853a6a09fd63627/pa/UB59400_4d69cf5af1c4bc4a0601eb04fdfdafe4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2016}
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB59400%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [auto1.be] INFO: Saving data for UB59400: {'created_time': 1774643866.402388, 'last_price_update_time': 1774643866.402401, 'auction_closing_time': 1774715222.0}
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB59400') HTTP/1.1" 204 0
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_693d70624f9b5fc4fede27da7151bdb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_693d70624f9b5fc4fede27da7151bdb4.jpg not downloaded yet
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_3132b28aa412ab5b14386762ead4c453.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_3132b28aa412ab5b14386762ead4c453.jpg not downloaded yet
2026-03-27 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ61910> (referer: https://www.auto1.com/v1/car-details-view/ZJ61910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_4e78ab712ab89bec1321c1b5737e300d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_4e78ab712ab89bec1321c1b5737e300d.jpg not downloaded yet
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_e65993c130d705f7506b9796cb60682c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e65993c130d705f7506b9796cb60682c.jpg not downloaded yet
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_b88887376f87152c159a3d4e361d3c75.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b88887376f87152c159a3d4e361d3c75.jpg not downloaded yet
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_c8b45566ff2f530d8ce920fee376bdb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_c8b45566ff2f530d8ce920fee376bdb3.jpg not downloaded yet
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_93ec7c4279c448fe9ae77c95ad96291d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_93ec7c4279c448fe9ae77c95ad96291d.jpg not downloaded yet
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_b83411582e187c764e005bc23da953ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b83411582e187c764e005bc23da953ff.jpg not downloaded yet
2026-03-27 20:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e99292ba-2cad-554b-9175-ae8de205b34d with identifier: ZJ61910
2026-03-27 20:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99292ba-2cad-554b-9175-ae8de205b34d with scrape type 1
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e99292ba-2cad-554b-9175-ae8de205b34d
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_fff5f5c5d60c6e1f5580256558efb55f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_fff5f5c5d60c6e1f5580256558efb55f.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_f371cb4c221240a92a0beb306977ad60.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_f371cb4c221240a92a0beb306977ad60.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_fed143d8e6fdc446e3ba252385eb7186.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_fed143d8e6fdc446e3ba252385eb7186.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_393a92071b16c3dc7b3f67cb52fda678.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_393a92071b16c3dc7b3f67cb52fda678.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_19ec074c32647935b978085043916a42.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_19ec074c32647935b978085043916a42.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_cf454940ca887fd37f17cac3a69c180a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_cf454940ca887fd37f17cac3a69c180a.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_1c6414e502390ad69889f61601748c8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_1c6414e502390ad69889f61601748c8b.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_71e70cd81ddd6ae9022b8e01ac5532b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_71e70cd81ddd6ae9022b8e01ac5532b3.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_b29f0f6418f1aef23005edcbcc4d6f64.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_b29f0f6418f1aef23005edcbcc4d6f64.jpg already downloaded
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Ff6%252F21f6025080bd800b68cbb71dc27f99c6%252Fpa%252FZJ61910_25f37ed660c0abeee4c5bc4c3ab831ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_25f37ed660c0abeee4c5bc4c3ab831ce.jpg already downloaded
2026-03-27 20:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e99292ba-2cad-554b-9175-ae8de205b34d, identifier: ZJ61910
2026-03-27 20:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e99292ba-2cad-554b-9175-ae8de205b34d with identifier: ZJ61910
2026-03-27 20:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e99292ba-2cad-554b-9175-ae8de205b34d with identifier: ZJ61910
2026-03-27 20:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e99292ba-2cad-554b-9175-ae8de205b34d with identifier: ZJ61910 to the API
2026-03-27 20:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZJ61910>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:42:00Z',
 'fuel_type': 'diesel',
 'id': 'e99292ba-2cad-554b-9175-ae8de205b34d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ61910',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 94639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_fff5f5c5d60c6e1f5580256558efb55f.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_f371cb4c221240a92a0beb306977ad60.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_fed143d8e6fdc446e3ba252385eb7186.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_393a92071b16c3dc7b3f67cb52fda678.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_19ec074c32647935b978085043916a42.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_cf454940ca887fd37f17cac3a69c180a.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_1c6414e502390ad69889f61601748c8b.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_71e70cd81ddd6ae9022b8e01ac5532b3.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_b29f0f6418f1aef23005edcbcc4d6f64.jpg',
                'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_25f37ed660c0abeee4c5bc4c3ab831ce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_fff5f5c5d60c6e1f5580256558efb55f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_f371cb4c221240a92a0beb306977ad60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_fed143d8e6fdc446e3ba252385eb7186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_393a92071b16c3dc7b3f67cb52fda678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_19ec074c32647935b978085043916a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_cf454940ca887fd37f17cac3a69c180a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_1c6414e502390ad69889f61601748c8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_71e70cd81ddd6ae9022b8e01ac5532b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_b29f0f6418f1aef23005edcbcc4d6f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99292ba-2cad-554b-9175-ae8de205b34d/e99292ba-2cad-554b-9175-ae8de205b34d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/f6/21f6025080bd800b68cbb71dc27f99c6/pa/ZJ61910_25f37ed660c0abeee4c5bc4c3ab831ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2022}
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ61910%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [auto1.be] INFO: Saving data for ZJ61910: {'created_time': 1774643867.187414, 'last_price_update_time': 1774643867.187426, 'auction_closing_time': 1774716120.0}
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ61910') HTTP/1.1" 204 0
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV41613> (referer: https://www.auto1.com/v1/car-details-view/BV41613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM47736> (referer: https://www.auto1.com/v1/car-details-view/HM47736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW39031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ27182> (referer: https://www.auto1.com/v1/car-details-view/JJ27182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK22486> (referer: https://www.auto1.com/v1/car-details-view/RK22486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD77902> (referer: https://www.auto1.com/v1/car-details-view/SD77902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b83411582e187c764e005bc23da953ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_93ec7c4279c448fe9ae77c95ad96291d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_c8b45566ff2f530d8ce920fee376bdb3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b88887376f87152c159a3d4e361d3c75.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-27 20:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with scrape type 1
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_b1208e486138ad30a0af07cc61662908.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_b1208e486138ad30a0af07cc61662908.jpg not downloaded yet
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e65993c130d705f7506b9796cb60682c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_4e78ab712ab89bec1321c1b5737e300d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_2de8a6d004107227c2019fb84ef09b90.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_2de8a6d004107227c2019fb84ef09b90.jpg not downloaded yet
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_693d70624f9b5fc4fede27da7151bdb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_3132b28aa412ab5b14386762ead4c453.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_ddfeccee006c7ce6bd166e4bdd29bd77.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_ddfeccee006c7ce6bd166e4bdd29bd77.jpg not downloaded yet
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_f0642aca33378e63e28dff0a44f5d770.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-27 20:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17002efe-7880-5c23-ba84-ffe2498431cb with scrape type 1
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_81a185d0ba2dcc5ebe2b828072df6310.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_81a185d0ba2dcc5ebe2b828072df6310.jpg not downloaded yet
2026-03-27 20:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-27 20:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with scrape type 1
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_0cd099d0f3fe6eded6779beca675260b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0cd099d0f3fe6eded6779beca675260b.jpg not downloaded yet
2026-03-27 20:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c955914-1cd8-5dbb-9f85-02db094e5814 with identifier: RK22486
2026-03-27 20:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c955914-1cd8-5dbb-9f85-02db094e5814 with scrape type 1
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_ebf39d7be11d8c74735c66e5bc6dd906.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_ebf39d7be11d8c74735c66e5bc6dd906.jpg not downloaded yet
2026-03-27 20:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-27 20:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3858bf66-719b-5ee3-a92c-0e3d097032db with scrape type 1
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_cab76659845c0f6140a88bb592ebb0bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_cab76659845c0f6140a88bb592ebb0bd.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_7b5f6959c13a6be368012977856db7a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_7b5f6959c13a6be368012977856db7a5.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_a7af69e00f96aeb6105e43bf1158dc39.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a7af69e00f96aeb6105e43bf1158dc39.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_87b77d91ecabf48129ec6dc2657214f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_87b77d91ecabf48129ec6dc2657214f5.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_bb841add79fb558020faf4f54e83ba3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_bb841add79fb558020faf4f54e83ba3e.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_9dbd9cb686a3420abdce80c88b323db8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_9dbd9cb686a3420abdce80c88b323db8.jpg not downloaded yet
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e9b2d4e706a169698fdc5345502c39a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_b1208e486138ad30a0af07cc61662908.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_05b5ce5fe82b538087e045f19e57232d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_05b5ce5fe82b538087e045f19e57232d.jpg not downloaded yet
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d46590>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_b83411582e187c764e005bc23da953ff.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b83411582e187c764e005bc23da953ff.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b0c90>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_93ec7c4279c448fe9ae77c95ad96291d.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_93ec7c4279c448fe9ae77c95ad96291d.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031bdc50>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_c8b45566ff2f530d8ce920fee376bdb3.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_c8b45566ff2f530d8ce920fee376bdb3.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033444d0>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_b88887376f87152c159a3d4e361d3c75.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b88887376f87152c159a3d4e361d3c75.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031befd0>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_e65993c130d705f7506b9796cb60682c.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e65993c130d705f7506b9796cb60682c.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b1810>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_4e78ab712ab89bec1321c1b5737e300d.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_4e78ab712ab89bec1321c1b5737e300d.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031cf010>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_693d70624f9b5fc4fede27da7151bdb4.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_693d70624f9b5fc4fede27da7151bdb4.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d47910>
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_3132b28aa412ab5b14386762ead4c453.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_3132b28aa412ab5b14386762ead4c453.jpg saved to cache
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_b8c8caa0780f7f8f903d09ccfde78d54.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_b8c8caa0780f7f8f903d09ccfde78d54.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_99a580f0ec6028464115c5d0b10690e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_99a580f0ec6028464115c5d0b10690e1.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_26afd886918c3f81f66b464bd5cb413d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_26afd886918c3f81f66b464bd5cb413d.jpg not downloaded yet
2026-03-27 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_b37edc670bfba33fb15c5c0bcc0e7be7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_b37edc670bfba33fb15c5c0bcc0e7be7.jpg not downloaded yet
2026-03-27 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_2de8a6d004107227c2019fb84ef09b90.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_658a760a51f37b65b58473fbd4b31992.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_658a760a51f37b65b58473fbd4b31992.jpg not downloaded yet
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031bcc10>
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_f0642aca33378e63e28dff0a44f5d770.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_f0642aca33378e63e28dff0a44f5d770.jpg saved to cache
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_f4bbea5af8c7fe4ac885c9267e683565.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_f4bbea5af8c7fe4ac885c9267e683565.jpg not downloaded yet
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_ed164ea5ef145828f09d3b61456482f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_ed164ea5ef145828f09d3b61456482f1.jpg not downloaded yet
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_4d59c6aac01cc3a2f7487c8a4295d196.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_4d59c6aac01cc3a2f7487c8a4295d196.jpg not downloaded yet
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_e745b70cc804f5df0002a844370e7ef6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e745b70cc804f5df0002a844370e7ef6.jpg not downloaded yet
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90311d1d0>
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F87%252Feb878481c75811e88559b504e04c26e8%252Fpa%252FJX95723_e9b2d4e706a169698fdc5345502c39a5.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e9b2d4e706a169698fdc5345502c39a5.jpg saved to cache
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b
2026-03-27 20:37:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31cc9e0e-9878-593c-aedf-fc0b5fab188b, skipping ID generation
2026-03-27 20:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b with scrape type 1
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31cc9e0e-9878-593c-aedf-fc0b5fab188b sending to next pipeline
2026-03-27 20:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31cc9e0e-9878-593c-aedf-fc0b5fab188b, identifier: JX95723
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031a7b90>
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_b1208e486138ad30a0af07cc61662908.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_b1208e486138ad30a0af07cc61662908.jpg saved to cache
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78
2026-03-27 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_7b5f6959c13a6be368012977856db7a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31cc9e0e-9878-593c-aedf-fc0b5fab188b with identifier: JX95723
2026-03-27 20:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31cc9e0e-9878-593c-aedf-fc0b5fab188b with identifier: JX95723
2026-03-27 20:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31cc9e0e-9878-593c-aedf-fc0b5fab188b with identifier: JX95723 to the API
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e9b2d4e706a169698fdc5345502c39a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 354,
 'expiration_date': '2026-03-28T16:07:40Z',
 'fuel_type': 'petrol',
 'id': '31cc9e0e-9878-593c-aedf-fc0b5fab188b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX95723',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 71416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e9b2d4e706a169698fdc5345502c39a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_f0642aca33378e63e28dff0a44f5d770.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_693d70624f9b5fc4fede27da7151bdb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_3132b28aa412ab5b14386762ead4c453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_4e78ab712ab89bec1321c1b5737e300d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_e65993c130d705f7506b9796cb60682c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b88887376f87152c159a3d4e361d3c75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_c8b45566ff2f530d8ce920fee376bdb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_93ec7c4279c448fe9ae77c95ad96291d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31cc9e0e-9878-593c-aedf-fc0b5fab188b/31cc9e0e-9878-593c-aedf-fc0b5fab188b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/87/eb878481c75811e88559b504e04c26e8/pa/JX95723_b83411582e187c764e005bc23da953ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX95723%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [auto1.be] INFO: Saving data for JX95723: {'created_time': 1774643868.88148, 'last_price_update_time': 1774643868.881492, 'auction_closing_time': 1774714060.0}
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX95723') HTTP/1.1" 204 0
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_a97b6fba562792b2afd74d19ee3d3fee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a97b6fba562792b2afd74d19ee3d3fee.jpg not downloaded yet
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_9ecbd487b66fbb9700249156f2a56d32.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_9ecbd487b66fbb9700249156f2a56d32.jpg not downloaded yet
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_0c04bbfe0e601ada243a980ff5e8676c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_0c04bbfe0e601ada243a980ff5e8676c.jpg not downloaded yet
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_becf66d78a7751ea27a83b75121527c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_becf66d78a7751ea27a83b75121527c8.jpg not downloaded yet
2026-03-27 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU58936> (referer: https://www.auto1.com/v1/car-details-view/HU58936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903233110>
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_2de8a6d004107227c2019fb84ef09b90.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_2de8a6d004107227c2019fb84ef09b90.jpg saved to cache
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_05b5ce5fe82b538087e045f19e57232d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_0ed01a644a3150ff2ce0b685b04944f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_0ed01a644a3150ff2ce0b685b04944f3.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_4a961bcb25e5afe6963fa9c2a4b3d1ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4a961bcb25e5afe6963fa9c2a4b3d1ff.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_8779e883b7648c30f3674953b62d2000.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_8779e883b7648c30f3674953b62d2000.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_218d367c98e8dadfd0ae2285e6f80e60.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_218d367c98e8dadfd0ae2285e6f80e60.jpg not downloaded yet
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM54686> (referer: https://www.auto1.com/v1/car-details-view/ZM54686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV56621> (referer: https://www.auto1.com/v1/car-details-view/BV56621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC19196> (referer: https://www.auto1.com/v1/car-details-view/TC19196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU98421> (referer: https://www.auto1.com/v1/car-details-view/NU98421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f94fd0>
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_7b5f6959c13a6be368012977856db7a5.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_7b5f6959c13a6be368012977856db7a5.jpg saved to cache
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78
2026-03-27 20:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU65745> (referer: https://www.auto1.com/v1/car-details-view/MU65745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_658a760a51f37b65b58473fbd4b31992.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_912a3b4e6c0df8b65c00fdba9b8d744e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_912a3b4e6c0df8b65c00fdba9b8d744e.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_7b7089ee2c4bf912ad364b4026378245.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_7b7089ee2c4bf912ad364b4026378245.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_fb898ea496b7eb9eca762c1de20987e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_fb898ea496b7eb9eca762c1de20987e9.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_e37ce2884ae05e2e7968e3b0c2824d68.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e37ce2884ae05e2e7968e3b0c2824d68.jpg not downloaded yet
2026-03-27 20:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-27 20:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with scrape type 1
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_6176887466be560dff1624dacc30ada4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6176887466be560dff1624dacc30ada4.jpg not downloaded yet
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90318db10>
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_05b5ce5fe82b538087e045f19e57232d.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_05b5ce5fe82b538087e045f19e57232d.jpg saved to cache
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_fe569398039dc33c123edf221aa93fde.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_fe569398039dc33c123edf221aa93fde.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_c128ef0958e6cba68e7e4e27861ae98e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_c128ef0958e6cba68e7e4e27861ae98e.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_3469afe72a4a70aeb7b63d44b1fe6225.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_3469afe72a4a70aeb7b63d44b1fe6225.jpg not downloaded yet
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_88503113e9c7b93076e35dcac822144c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_88503113e9c7b93076e35dcac822144c.jpg not downloaded yet
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a97b6fba562792b2afd74d19ee3d3fee.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_0818e200593984c7bfef0f7f2f440583.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0818e200593984c7bfef0f7f2f440583.jpg not downloaded yet
2026-03-27 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-27 20:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f965cd-80bc-50d1-8249-4abc3c377c86 with scrape type 1
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0f965cd-80bc-50d1-8249-4abc3c377c86
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_ecee131869241570eeeb7e38906e6bac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_ecee131869241570eeeb7e38906e6bac.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_9f05704b28d44e43d0597b87015d4f6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_9f05704b28d44e43d0597b87015d4f6a.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_db880c9984fd964ed1836277746ef8c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_db880c9984fd964ed1836277746ef8c4.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_ad1c6314851defd7beac07dab6ef7a8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_ad1c6314851defd7beac07dab6ef7a8b.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_904fdbbf8057fb64ea92cbfeacee13b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_904fdbbf8057fb64ea92cbfeacee13b1.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_2a68ce3b9adf1b0aac7f05a24231a60d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_2a68ce3b9adf1b0aac7f05a24231a60d.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_56e62977c8b58bde93b09daa320546da.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_56e62977c8b58bde93b09daa320546da.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_5559dcbc2ba5acce3bbcda6b7bc148ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_5559dcbc2ba5acce3bbcda6b7bc148ed.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_fcc4de372566e49cad2efa38777d63c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_fcc4de372566e49cad2efa38777d63c3.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa6%252Ff8a64b59b393b9e96abf3fd392d9559c%252Fpa%252FZM54686_f05ecddfd59130edc04bf168773612c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_f05ecddfd59130edc04bf168773612c3.jpg already downloaded
2026-03-27 20:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0f965cd-80bc-50d1-8249-4abc3c377c86, identifier: ZM54686
2026-03-27 20:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-27 20:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54af18b5-21b7-5c6d-b43c-996322979c28 with scrape type 1
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_2959de837ee78a1929c13247cf7aaf2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_2959de837ee78a1929c13247cf7aaf2f.jpg not downloaded yet
2026-03-27 20:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-27 20:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77902958-9672-5cc1-9fff-811befb56fcc with scrape type 1
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77902958-9672-5cc1-9fff-811befb56fcc
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_f2a2420512aac3a43a04bdbcb36a77db.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_f2a2420512aac3a43a04bdbcb36a77db.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_d71d222708324e39ce836a50eff1a314.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_d71d222708324e39ce836a50eff1a314.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_074541ade53ff8b1ecca39a85b6c1736.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_074541ade53ff8b1ecca39a85b6c1736.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_96ed573f94f186ac15c936f7cb14037b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_96ed573f94f186ac15c936f7cb14037b.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_8a6911cad2eafdac944c75312ef0278b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_8a6911cad2eafdac944c75312ef0278b.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_26eac4fd28d8d36184f7f79b9680eb54.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_26eac4fd28d8d36184f7f79b9680eb54.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_9fa1e4deec06235357996b2b8c874ef9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_9fa1e4deec06235357996b2b8c874ef9.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_83fe255d547eadcd2af8b73a40c893b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_83fe255d547eadcd2af8b73a40c893b0.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_b40e4592e4220824907e376c578cdabf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_b40e4592e4220824907e376c578cdabf.jpg already downloaded
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F69%252Fb969e6d875118b699e6ef85a0f3f4579%252Fpa%252FTC19196_a1b355ecf162d64ebae32c01b64b6687.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_a1b355ecf162d64ebae32c01b64b6687.jpg already downloaded
2026-03-27 20:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77902958-9672-5cc1-9fff-811befb56fcc, identifier: TC19196
2026-03-27 20:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-27 20:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925d536b-fe72-535e-ba07-122209d6df04 with scrape type 1
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_2fe60ef6809fc1fd63365a161b67c9d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_2fe60ef6809fc1fd63365a161b67c9d2.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_71a70fd5c9427b800ab329e37f828011.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_71a70fd5c9427b800ab329e37f828011.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_4d8822d39807c122b219220a8c5a1a1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4d8822d39807c122b219220a8c5a1a1e.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_7c518c4a5ac398416c93c8ddee101e4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_7c518c4a5ac398416c93c8ddee101e4f.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_2dde1adc073dccdf693d178ef9a15f28.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_2dde1adc073dccdf693d178ef9a15f28.jpg not downloaded yet
2026-03-27 20:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-27 20:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686
2026-03-27 20:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0f965cd-80bc-50d1-8249-4abc3c377c86 with identifier: ZM54686 to the API
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM54686>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:23:19Z',
 'fuel_type': 'petrol',
 'id': 'c0f965cd-80bc-50d1-8249-4abc3c377c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM54686',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 63877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_ecee131869241570eeeb7e38906e6bac.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_9f05704b28d44e43d0597b87015d4f6a.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_db880c9984fd964ed1836277746ef8c4.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_ad1c6314851defd7beac07dab6ef7a8b.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_904fdbbf8057fb64ea92cbfeacee13b1.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_2a68ce3b9adf1b0aac7f05a24231a60d.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_56e62977c8b58bde93b09daa320546da.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_5559dcbc2ba5acce3bbcda6b7bc148ed.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_fcc4de372566e49cad2efa38777d63c3.jpg',
                'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_f05ecddfd59130edc04bf168773612c3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_ecee131869241570eeeb7e38906e6bac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2711323,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_9f05704b28d44e43d0597b87015d4f6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_db880c9984fd964ed1836277746ef8c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2373822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_ad1c6314851defd7beac07dab6ef7a8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_904fdbbf8057fb64ea92cbfeacee13b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_2a68ce3b9adf1b0aac7f05a24231a60d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_56e62977c8b58bde93b09daa320546da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_5559dcbc2ba5acce3bbcda6b7bc148ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_fcc4de372566e49cad2efa38777d63c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f965cd-80bc-50d1-8249-4abc3c377c86/c0f965cd-80bc-50d1-8249-4abc3c377c86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a6/f8a64b59b393b9e96abf3fd392d9559c/pa/ZM54686_f05ecddfd59130edc04bf168773612c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [auto1.be] INFO: Saving data for ZM54686: {'created_time': 1774643870.438204, 'last_price_update_time': 1774643870.438214, 'auction_closing_time': 1774714999.0}
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM54686') HTTP/1.1" 204 0
2026-03-27 20:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-27 20:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-27 20:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196 to the API
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC19196>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:28:17Z',
 'fuel_type': 'diesel',
 'id': '77902958-9672-5cc1-9fff-811befb56fcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC19196',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 174112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_f2a2420512aac3a43a04bdbcb36a77db.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_d71d222708324e39ce836a50eff1a314.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_074541ade53ff8b1ecca39a85b6c1736.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_96ed573f94f186ac15c936f7cb14037b.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_8a6911cad2eafdac944c75312ef0278b.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_26eac4fd28d8d36184f7f79b9680eb54.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_9fa1e4deec06235357996b2b8c874ef9.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_83fe255d547eadcd2af8b73a40c893b0.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_b40e4592e4220824907e376c578cdabf.jpg',
                'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_a1b355ecf162d64ebae32c01b64b6687.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_f2a2420512aac3a43a04bdbcb36a77db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_d71d222708324e39ce836a50eff1a314.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_074541ade53ff8b1ecca39a85b6c1736.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_96ed573f94f186ac15c936f7cb14037b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_8a6911cad2eafdac944c75312ef0278b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_26eac4fd28d8d36184f7f79b9680eb54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_9fa1e4deec06235357996b2b8c874ef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_83fe255d547eadcd2af8b73a40c893b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_b40e4592e4220824907e376c578cdabf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77902958-9672-5cc1-9fff-811befb56fcc/77902958-9672-5cc1-9fff-811befb56fcc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/69/b969e6d875118b699e6ef85a0f3f4579/pa/TC19196_a1b355ecf162d64ebae32c01b64b6687.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XJ 3.0 D V6 Portfolio',
 'transmission': 'automatic',
 'trim': 'Portfolio',
 'year': 2021}
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [auto1.be] INFO: Saving data for TC19196: {'created_time': 1774643870.70738, 'last_price_update_time': 1774643870.707392, 'auction_closing_time': 1774715297.0}
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC19196') HTTP/1.1" 204 0
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_19b9d9e2fa9e6f18c4420fa12382ded1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_19b9d9e2fa9e6f18c4420fa12382ded1.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_212ce87620374900acf927640d54acda.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_212ce87620374900acf927640d54acda.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_c321aa1598414624e1a3dcedd5c7194e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_c321aa1598414624e1a3dcedd5c7194e.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_05aa23d44ea1144bb4ae9844fda32249.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_05aa23d44ea1144bb4ae9844fda32249.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_0f8333b0afed18656ad979d7772abfa0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0f8333b0afed18656ad979d7772abfa0.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_d1114395681961e105812009816599b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_d1114395681961e105812009816599b6.jpg not downloaded yet
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_fabc5ca22aec73ce72d2676223a7da30.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_fabc5ca22aec73ce72d2676223a7da30.jpg not downloaded yet
2026-03-27 20:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16419153-7b4e-551f-b339-2cb64a619ec6 with identifier: MU65745
2026-03-27 20:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16419153-7b4e-551f-b339-2cb64a619ec6 with scrape type 1
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16419153-7b4e-551f-b339-2cb64a619ec6
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_b4067352915a10205a321e789e8d23bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_b4067352915a10205a321e789e8d23bd.jpg already downloaded
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_df01514653bbe7f3bc0f0e784a3bd274.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_df01514653bbe7f3bc0f0e784a3bd274.jpg already downloaded
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_5bbf300334194622145cf455c199ed86.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_5bbf300334194622145cf455c199ed86.jpg already downloaded
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_a143e65fdb8eca3755dd2c0e8343e509.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_a143e65fdb8eca3755dd2c0e8343e509.jpg already downloaded
2026-03-27 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_19d160e4379cbd3ac7dfa77220658266.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_19d160e4379cbd3ac7dfa77220658266.jpg already downloaded
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_27aaa550d9ce93e0d5e0489e0cea4a2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_27aaa550d9ce93e0d5e0489e0cea4a2c.jpg already downloaded
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_71bd19e46126c99bc6e2c34c9f42727d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_71bd19e46126c99bc6e2c34c9f42727d.jpg already downloaded
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_28d3be42a592f74f0fad0a8820e4b14b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_28d3be42a592f74f0fad0a8820e4b14b.jpg already downloaded
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_e556efc316c50f91ab368c8a8e705af5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_e556efc316c50f91ab368c8a8e705af5.jpg already downloaded
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fa7%252Fe4a7fea14f6c3681f50e4a68b06cdca7%252Fpa%252FMU65745_ca26c1dfd9d5ae7a361159f37b064e28.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_ca26c1dfd9d5ae7a361159f37b064e28.jpg already downloaded
2026-03-27 20:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16419153-7b4e-551f-b339-2cb64a619ec6, identifier: MU65745
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911e45010>
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_658a760a51f37b65b58473fbd4b31992.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_658a760a51f37b65b58473fbd4b31992.jpg saved to cache
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323ec10>
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_a97b6fba562792b2afd74d19ee3d3fee.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a97b6fba562792b2afd74d19ee3d3fee.jpg saved to cache
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:37:51 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_78181756cb8b3809113b296a9411ea1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_78181756cb8b3809113b296a9411ea1d.jpg not downloaded yet
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_4e8ec62c496709e3e3e0ea1ccec5ac5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_4e8ec62c496709e3e3e0ea1ccec5ac5c.jpg not downloaded yet
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_ca2f5834ee5336ee35b7ab8095df72ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_ca2f5834ee5336ee35b7ab8095df72ac.jpg not downloaded yet
2026-03-27 20:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16419153-7b4e-551f-b339-2cb64a619ec6 with identifier: MU65745
2026-03-27 20:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16419153-7b4e-551f-b339-2cb64a619ec6 with identifier: MU65745
2026-03-27 20:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16419153-7b4e-551f-b339-2cb64a619ec6 with identifier: MU65745 to the API
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MU65745>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:52:31Z',
 'fuel_type': 'petrol',
 'id': '16419153-7b4e-551f-b339-2cb64a619ec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU65745',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 77066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_b4067352915a10205a321e789e8d23bd.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_df01514653bbe7f3bc0f0e784a3bd274.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_5bbf300334194622145cf455c199ed86.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_a143e65fdb8eca3755dd2c0e8343e509.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_19d160e4379cbd3ac7dfa77220658266.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_27aaa550d9ce93e0d5e0489e0cea4a2c.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_71bd19e46126c99bc6e2c34c9f42727d.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_28d3be42a592f74f0fad0a8820e4b14b.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_e556efc316c50f91ab368c8a8e705af5.jpg',
                'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_ca26c1dfd9d5ae7a361159f37b064e28.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_b4067352915a10205a321e789e8d23bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_df01514653bbe7f3bc0f0e784a3bd274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_5bbf300334194622145cf455c199ed86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_a143e65fdb8eca3755dd2c0e8343e509.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_19d160e4379cbd3ac7dfa77220658266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_27aaa550d9ce93e0d5e0489e0cea4a2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_71bd19e46126c99bc6e2c34c9f42727d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_28d3be42a592f74f0fad0a8820e4b14b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_e556efc316c50f91ab368c8a8e705af5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16419153-7b4e-551f-b339-2cb64a619ec6/16419153-7b4e-551f-b339-2cb64a619ec6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/a7/e4a7fea14f6c3681f50e4a68b06cdca7/pa/MU65745_ca26c1dfd9d5ae7a361159f37b064e28.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia pro_cee'd 1.4 TGDI GT Line",
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2020}
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU65745%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [auto1.be] INFO: Saving data for MU65745: {'created_time': 1774643871.60612, 'last_price_update_time': 1774643871.606131, 'auction_closing_time': 1774716751.0}
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MU65745') HTTP/1.1" 204 0
2026-03-27 20:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_9ecbd487b66fbb9700249156f2a56d32.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:51 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [auto1.be] INFO: Scrape type for RA52713: 2
2026-03-27 20:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-27 20:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff40a98-1a29-5a0c-bc27-394239566acc with scrape type 2
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff40a98-1a29-5a0c-bc27-394239566acc with scrape type 2
2026-03-27 20:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dff40a98-1a29-5a0c-bc27-394239566acc, identifier: RA52713
2026-03-27 20:37:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_6da2bada02258800b2b9cc0b8809c51e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6da2bada02258800b2b9cc0b8809c51e.jpg not downloaded yet
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_af79c5c5160699848e5b7838c75eda2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_af79c5c5160699848e5b7838c75eda2a.jpg not downloaded yet
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_f22b8086a9ce06ba15597589f9e392bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_f22b8086a9ce06ba15597589f9e392bc.jpg not downloaded yet
2026-03-27 20:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-27 20:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-27 20:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713 to the API
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:35:46Z',
 'fuel_type': 'diesel',
 'id': 'dff40a98-1a29-5a0c-bc27-394239566acc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA52713',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 97098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [auto1.be] INFO: Saving data for RA52713: {'auction_closing_time': 1774715746.0, 'created_time': 1773134356.130771, 'last_price_update_time': 1774643872.072302}
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA52713') HTTP/1.1" 204 0
2026-03-27 20:37:52 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-27 20:37:52 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-27 20:37:52 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP34819%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [auto1.be] INFO: Scrape type for TP34819: 2
2026-03-27 20:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d71fdc-ada3-580b-becc-182373baa300 with identifier: TP34819
2026-03-27 20:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d71fdc-ada3-580b-becc-182373baa300 with scrape type 2
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2d71fdc-ada3-580b-becc-182373baa300 with scrape type 2
2026-03-27 20:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2d71fdc-ada3-580b-becc-182373baa300, identifier: TP34819
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_856729b7f8738796fe29d6b57e79a07d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_856729b7f8738796fe29d6b57e79a07d.jpg not downloaded yet
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_851f7f4d16b89a416bfccd221b955d09.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_851f7f4d16b89a416bfccd221b955d09.jpg not downloaded yet
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_54be774d4d40c3ff5704126d9a2ea7af.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_54be774d4d40c3ff5704126d9a2ea7af.jpg not downloaded yet
2026-03-27 20:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2d71fdc-ada3-580b-becc-182373baa300 with identifier: TP34819
2026-03-27 20:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2d71fdc-ada3-580b-becc-182373baa300 with identifier: TP34819
2026-03-27 20:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2d71fdc-ada3-580b-becc-182373baa300 with identifier: TP34819 to the API
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:12:48Z',
 'fuel_type': 'diesel',
 'id': 'e2d71fdc-ada3-580b-becc-182373baa300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP34819',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 181544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-17',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2009}
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP34819%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [auto1.be] INFO: Saving data for TP34819: {'auction_closing_time': 1774714368.0, 'created_time': 1773135669.466683, 'last_price_update_time': 1774643872.563133}
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TP34819') HTTP/1.1" 204 0
2026-03-27 20:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6176887466be560dff1624dacc30ada4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:52 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV25434%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [auto1.be] INFO: Scrape type for MV25434: 1
2026-03-27 20:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG12074> (referer: https://www.auto1.com/v1/car-details-view/MG12074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP17871/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_bf4b4dc43dba3331c86035be297a15b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_bf4b4dc43dba3331c86035be297a15b2.jpg not downloaded yet
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_d095322f1a77d40a2189120ef9c2fd91.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d095322f1a77d40a2189120ef9c2fd91.jpg not downloaded yet
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_1d27a241e8f7be3d0e8b7164f9526457.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_1d27a241e8f7be3d0e8b7164f9526457.jpg not downloaded yet
2026-03-27 20:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF59925> (referer: https://www.auto1.com/v1/car-details-view/UF59925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:37:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:37:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:37:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:37:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903393cd0>
2026-03-27 20:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_9ecbd487b66fbb9700249156f2a56d32.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_9ecbd487b66fbb9700249156f2a56d32.jpg saved to cache
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:37:52 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-27 20:37:52 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ13946%27 HTTP/1.1" 200 None
2026-03-27 20:37:52 [auto1.be] INFO: Scrape type for XZ13946: 2
2026-03-27 20:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac9cc37d-16af-503e-bf56-f6a1c5b5fa04 with identifier: XZ13946
2026-03-27 20:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac9cc37d-16af-503e-bf56-f6a1c5b5fa04 with scrape type 2
2026-03-27 20:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac9cc37d-16af-503e-bf56-f6a1c5b5fa04 with scrape type 2
2026-03-27 20:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac9cc37d-16af-503e-bf56-f6a1c5b5fa04, identifier: XZ13946
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_0ddb4fcd3be208d41d4e0e2aa9fd1285.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0ddb4fcd3be208d41d4e0e2aa9fd1285.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_bd0a4645968f55416e76a3f044cd6194.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_bd0a4645968f55416e76a3f044cd6194.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_0a069f4000aa8ab188b0ca225be64f24.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_0a069f4000aa8ab188b0ca225be64f24.jpg not downloaded yet
2026-03-27 20:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac9cc37d-16af-503e-bf56-f6a1c5b5fa04 with identifier: XZ13946
2026-03-27 20:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac9cc37d-16af-503e-bf56-f6a1c5b5fa04 with identifier: XZ13946
2026-03-27 20:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac9cc37d-16af-503e-bf56-f6a1c5b5fa04 with identifier: XZ13946 to the API
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:41:47Z',
 'fuel_type': 'diesel',
 'id': 'ac9cc37d-16af-503e-bf56-f6a1c5b5fa04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ13946',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 245469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ13946%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [auto1.be] INFO: Saving data for XZ13946: {'auction_closing_time': 1774716107.0, 'created_time': 1773135949.129297, 'last_price_update_time': 1774643873.348563}
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ13946') HTTP/1.1" 204 0
2026-03-27 20:37:53 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC83971%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [auto1.be] INFO: Scrape type for JC83971: 1
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_5dbf0149370854213fe803cdf8d63999.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_5dbf0149370854213fe803cdf8d63999.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_d02346c6cb125ca94425468ecde7e1fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d02346c6cb125ca94425468ecde7e1fb.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_3c68e10f53a2aeaa2020b58750ae721d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_3c68e10f53a2aeaa2020b58750ae721d.jpg not downloaded yet
2026-03-27 20:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP70611> (referer: https://www.auto1.com/v1/car-details-view/JP70611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:53 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-27 20:37:53 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ63338%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [auto1.be] INFO: Scrape type for VJ63338: 1
2026-03-27 20:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdb890>
2026-03-27 20:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_6176887466be560dff1624dacc30ada4.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6176887466be560dff1624dacc30ada4.jpg saved to cache
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-27 20:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233a848e-6c23-55cb-beeb-a529abb7e4c5 with scrape type 1
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_50b18ee04794bec454fd8827bd32e825.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_50b18ee04794bec454fd8827bd32e825.jpg not downloaded yet
2026-03-27 20:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-27 20:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb397cae-cd70-5757-9a4a-4f90035e4674 with scrape type 1
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_d7212f62dd8e6721201f1e66aec9d848.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_d7212f62dd8e6721201f1e66aec9d848.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_2c4b000f5bd6e35a1654d0f123032d1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_2c4b000f5bd6e35a1654d0f123032d1e.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_57f1ca1a5b768bfc1bbabf76a3fd2911.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_57f1ca1a5b768bfc1bbabf76a3fd2911.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_882740f2cb6f33a959af2494f82213ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_882740f2cb6f33a959af2494f82213ac.jpg not downloaded yet
2026-03-27 20:37:53 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [auto1.be] INFO: Scrape type for MX26890: 2
2026-03-27 20:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-27 20:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with scrape type 2
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with scrape type 2
2026-03-27 20:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5, identifier: MX26890
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_7d15f8b3cef647c0519e95e9627bae65.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_7d15f8b3cef647c0519e95e9627bae65.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_dcca55fc74ed5b55028fe36e40e078d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_dcca55fc74ed5b55028fe36e40e078d3.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_38ee106f8406a3f9ca834dcef6fc92b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_38ee106f8406a3f9ca834dcef6fc92b0.jpg not downloaded yet
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_a80be68c0d571083ea3d3c8fe2b25bbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_a80be68c0d571083ea3d3c8fe2b25bbe.jpg not downloaded yet
2026-03-27 20:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-27 20:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-27 20:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890 to the API
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:35:36Z',
 'fuel_type': 'petrol',
 'id': '9dbb4816-4c7f-5b89-84c4-36c8814b7af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX26890',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 90514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [auto1.be] INFO: Saving data for MX26890: {'auction_closing_time': 1774715736.0, 'created_time': 1773137472.010623, 'last_price_update_time': 1774643874.075303}
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX26890') HTTP/1.1" 204 0
2026-03-27 20:37:54 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-27 20:37:54 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-27 20:37:54 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT11413%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [auto1.be] INFO: Scrape type for KT11413: 2
2026-03-27 20:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee962380-752b-5feb-89aa-23120deb4069 with identifier: KT11413
2026-03-27 20:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee962380-752b-5feb-89aa-23120deb4069 with scrape type 2
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee962380-752b-5feb-89aa-23120deb4069 with scrape type 2
2026-03-27 20:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee962380-752b-5feb-89aa-23120deb4069, identifier: KT11413
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_24c8290e4d796e4b6848b3d95a871579.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_24c8290e4d796e4b6848b3d95a871579.jpg not downloaded yet
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_853afa9ebccd909202d8c8476fb3d50c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_853afa9ebccd909202d8c8476fb3d50c.jpg not downloaded yet
2026-03-27 20:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee962380-752b-5feb-89aa-23120deb4069 with identifier: KT11413
2026-03-27 20:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee962380-752b-5feb-89aa-23120deb4069 with identifier: KT11413
2026-03-27 20:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee962380-752b-5feb-89aa-23120deb4069 with identifier: KT11413 to the API
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'diesel',
 'id': 'ee962380-752b-5feb-89aa-23120deb4069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT11413',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 127433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-05',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2014}
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT11413%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [auto1.be] INFO: Saving data for KT11413: {'auction_closing_time': 1774715601.0, 'created_time': 1773137036.208287, 'last_price_update_time': 1774643874.602945}
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT11413') HTTP/1.1" 204 0
2026-03-27 20:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c2f2773-6a27-5e9e-82c8-c7727b0931eb with identifier: JP70611
2026-03-27 20:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c2f2773-6a27-5e9e-82c8-c7727b0931eb with scrape type 1
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c2f2773-6a27-5e9e-82c8-c7727b0931eb
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_3cdbefdc5f2087df3959b35f230e0d1a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_3cdbefdc5f2087df3959b35f230e0d1a.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_6888a6330b75566b64bdb1ea36105cd9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_6888a6330b75566b64bdb1ea36105cd9.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_8753bad9ff7282a1d1b402b083931655.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_8753bad9ff7282a1d1b402b083931655.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_8aa3badfe3f3d1c773857d3fd8680465.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_8aa3badfe3f3d1c773857d3fd8680465.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_9d4453f511ae889b607b3a75bccb1a2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_9d4453f511ae889b607b3a75bccb1a2d.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_ff22bde79d67e1bb3a13452a44982f4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_ff22bde79d67e1bb3a13452a44982f4f.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_2d3dfd8ae4056ee52af647b37584c2fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_2d3dfd8ae4056ee52af647b37584c2fc.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_41d22e68f1abaf38866349863f5789e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_41d22e68f1abaf38866349863f5789e2.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_c9eb97617922e1b319f4bbc315fe18b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_c9eb97617922e1b319f4bbc315fe18b5.jpg already downloaded
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F2b%252F282bfdbf63506868c60bfaf2acb99cde%252Fpa%252FJP70611_6c17b8028bcaccd2ed5518456cac27a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_6c17b8028bcaccd2ed5518456cac27a4.jpg already downloaded
2026-03-27 20:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c2f2773-6a27-5e9e-82c8-c7727b0931eb, identifier: JP70611
2026-03-27 20:37:54 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-27 20:37:54 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [auto1.be] INFO: Scrape type for WJ85942: 1
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_e35e68985223d816f8036d8684bf4b98.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_e35e68985223d816f8036d8684bf4b98.jpg not downloaded yet
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_b2998987ca07d017344aa21cb4a623af.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_b2998987ca07d017344aa21cb4a623af.jpg not downloaded yet
2026-03-27 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c2f2773-6a27-5e9e-82c8-c7727b0931eb with identifier: JP70611
2026-03-27 20:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c2f2773-6a27-5e9e-82c8-c7727b0931eb with identifier: JP70611
2026-03-27 20:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c2f2773-6a27-5e9e-82c8-c7727b0931eb with identifier: JP70611 to the API
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JP70611>
{'auction_title': '',
 'c_o_2_emission_value': 21,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:36:59Z',
 'fuel_type': 'hybrid',
 'id': '3c2f2773-6a27-5e9e-82c8-c7727b0931eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP70611',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 141780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photo_urls': ['https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_3cdbefdc5f2087df3959b35f230e0d1a.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_6888a6330b75566b64bdb1ea36105cd9.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_8753bad9ff7282a1d1b402b083931655.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_8aa3badfe3f3d1c773857d3fd8680465.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_9d4453f511ae889b607b3a75bccb1a2d.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_ff22bde79d67e1bb3a13452a44982f4f.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_2d3dfd8ae4056ee52af647b37584c2fc.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_41d22e68f1abaf38866349863f5789e2.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_c9eb97617922e1b319f4bbc315fe18b5.jpg',
                'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_6c17b8028bcaccd2ed5518456cac27a4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_3cdbefdc5f2087df3959b35f230e0d1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_6888a6330b75566b64bdb1ea36105cd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_8753bad9ff7282a1d1b402b083931655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_8aa3badfe3f3d1c773857d3fd8680465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_9d4453f511ae889b607b3a75bccb1a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_ff22bde79d67e1bb3a13452a44982f4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_2d3dfd8ae4056ee52af647b37584c2fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_41d22e68f1abaf38866349863f5789e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_c9eb97617922e1b319f4bbc315fe18b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c2f2773-6a27-5e9e-82c8-c7727b0931eb/3c2f2773-6a27-5e9e-82c8-c7727b0931eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/2b/282bfdbf63506868c60bfaf2acb99cde/pa/JP70611_6c17b8028bcaccd2ed5518456cac27a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP70611%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [auto1.be] INFO: Saving data for JP70611: {'created_time': 1774643875.241234, 'last_price_update_time': 1774643875.241244, 'auction_closing_time': 1774715819.0}
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JP70611') HTTP/1.1" 204 0
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY09771%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [auto1.be] INFO: Scrape type for HY09771: 1
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_ea81ec18d5dfa8938d23e996bf42bc2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_ea81ec18d5dfa8938d23e996bf42bc2a.jpg not downloaded yet
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_a963916f27da309e777b2c29da99c20d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_a963916f27da309e777b2c29da99c20d.jpg not downloaded yet
2026-03-27 20:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK56681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [auto1.be] INFO: Scrape type for ZX91910: 2
2026-03-27 20:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-27 20:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8339274d-c6a2-5f32-9851-1f9516d45de0 with scrape type 2
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8339274d-c6a2-5f32-9851-1f9516d45de0 with scrape type 2
2026-03-27 20:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8339274d-c6a2-5f32-9851-1f9516d45de0, identifier: ZX91910
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_d7f63c3dd55a6c673013ccb799875d1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_d7f63c3dd55a6c673013ccb799875d1d.jpg not downloaded yet
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_2fccceae103f5a53583a684543fd605d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_2fccceae103f5a53583a684543fd605d.jpg not downloaded yet
2026-03-27 20:37:55 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1659 | hits on page: 40
2026-03-27 20:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-27 20:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-27 20:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910 to the API
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:12Z',
 'fuel_type': 'diesel',
 'id': '8339274d-c6a2-5f32-9851-1f9516d45de0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX91910',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 39745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 BLUE dCi L2H1 3,0t Komfort',
 'transmission': 'automatic',
 'trim': 'L2H1 3,0t Komfort',
 'year': 2022}
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [auto1.be] INFO: Saving data for ZX91910: {'auction_closing_time': 1774714572.0, 'created_time': 1773137643.772233, 'last_price_update_time': 1774643875.731912}
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX91910') HTTP/1.1" 204 0
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ75207%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [auto1.be] INFO: Scrape type for FJ75207: 2
2026-03-27 20:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d36b44dd-f9e0-57b1-9295-91bb36f36b6b with identifier: FJ75207
2026-03-27 20:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d36b44dd-f9e0-57b1-9295-91bb36f36b6b with scrape type 2
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d36b44dd-f9e0-57b1-9295-91bb36f36b6b with scrape type 2
2026-03-27 20:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d36b44dd-f9e0-57b1-9295-91bb36f36b6b, identifier: FJ75207
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_387602c34c2f207d6155402f13344b9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_387602c34c2f207d6155402f13344b9c.jpg not downloaded yet
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_9bf01e58acb7917f2e9e384074c96e0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_9bf01e58acb7917f2e9e384074c96e0f.jpg not downloaded yet
2026-03-27 20:37:55 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-27 20:37:55 [auto1.be] INFO: Scrape type for JC93215: 1
2026-03-27 20:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d36b44dd-f9e0-57b1-9295-91bb36f36b6b with identifier: FJ75207
2026-03-27 20:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d36b44dd-f9e0-57b1-9295-91bb36f36b6b with identifier: FJ75207
2026-03-27 20:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d36b44dd-f9e0-57b1-9295-91bb36f36b6b with identifier: FJ75207 to the API
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:53:52Z',
 'fuel_type': 'diesel',
 'id': 'd36b44dd-f9e0-57b1-9295-91bb36f36b6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ75207',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 186164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-18',
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ75207%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [auto1.be] INFO: Saving data for FJ75207: {'auction_closing_time': 1774716832.0, 'created_time': 1773135244.241267, 'last_price_update_time': 1774643876.264598}
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ75207') HTTP/1.1" 204 0
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL87249%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [auto1.be] INFO: Scrape type for EL87249: 1
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_16044b01fc204635625a6d7824190514.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_16044b01fc204635625a6d7824190514.jpg not downloaded yet
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_96192cdcd811161b8f9e304a95fad967.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_96192cdcd811161b8f9e304a95fad967.jpg not downloaded yet
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [auto1.be] INFO: Scrape type for RM32931: 1
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [auto1.be] INFO: Scrape type for FR50529: 1
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_0d8888441ae0a8077046d5614d738520.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_0d8888441ae0a8077046d5614d738520.jpg not downloaded yet
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_4f9460e0e9805839b3e024964c4cde39.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_4f9460e0e9805839b3e024964c4cde39.jpg not downloaded yet
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [auto1.be] INFO: Scrape type for KG53590: 2
2026-03-27 20:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-27 20:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00394349-364e-5ec8-99db-b307e0845906 with scrape type 2
2026-03-27 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00394349-364e-5ec8-99db-b307e0845906 with scrape type 2
2026-03-27 20:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00394349-364e-5ec8-99db-b307e0845906, identifier: KG53590
2026-03-27 20:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_cab76659845c0f6140a88bb592ebb0bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_8779e883b7648c30f3674953b62d2000.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-27 20:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590
2026-03-27 20:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00394349-364e-5ec8-99db-b307e0845906 with identifier: KG53590 to the API
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:05:10Z',
 'fuel_type': 'petrol',
 'id': '00394349-364e-5ec8-99db-b307e0845906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG53590',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 79099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.2 TFSI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2014}
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [auto1.be] INFO: Saving data for KG53590: {'auction_closing_time': 1774713910.0, 'created_time': 1773834443.225994, 'last_price_update_time': 1774643876.859658}
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG53590') HTTP/1.1" 204 0
2026-03-27 20:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-27 20:37:56 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [auto1.be] INFO: Scrape type for VV25356: 2
2026-03-27 20:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-27 20:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fbf830-2835-5e03-8045-87bd14110175 with scrape type 2
2026-03-27 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fbf830-2835-5e03-8045-87bd14110175 with scrape type 2
2026-03-27 20:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98fbf830-2835-5e03-8045-87bd14110175, identifier: VV25356
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_1615655fabfc9427d3d7fe7ced310651.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_1615655fabfc9427d3d7fe7ced310651.jpg not downloaded yet
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_009ab14a5457ae4d5415c81c327a712c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_009ab14a5457ae4d5415c81c327a712c.jpg not downloaded yet
2026-03-27 20:37:57 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-27 20:37:57 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-27 20:37:57 [auto1.be] INFO: Scrape type for TD70367: 2
2026-03-27 20:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-27 20:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497437b8-5a84-5bda-a08c-1e6314a053c7 with scrape type 2
2026-03-27 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497437b8-5a84-5bda-a08c-1e6314a053c7 with scrape type 2
2026-03-27 20:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 497437b8-5a84-5bda-a08c-1e6314a053c7, identifier: TD70367
2026-03-27 20:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-27 20:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356
2026-03-27 20:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98fbf830-2835-5e03-8045-87bd14110175 with identifier: VV25356 to the API
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:21:00Z',
 'fuel_type': 'diesel',
 'id': '98fbf830-2835-5e03-8045-87bd14110175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV25356',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 49681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-27 20:37:57 [auto1.be] INFO: Saving data for VV25356: {'auction_closing_time': 1774714860.0, 'created_time': 1773822949.693674, 'last_price_update_time': 1774643877.450007}
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VV25356') HTTP/1.1" 204 0
2026-03-27 20:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-27 20:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367
2026-03-27 20:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 497437b8-5a84-5bda-a08c-1e6314a053c7 with identifier: TD70367 to the API
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:09:09Z',
 'fuel_type': 'diesel',
 'id': '497437b8-5a84-5bda-a08c-1e6314a053c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD70367',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 192011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-12',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-27 20:37:57 [auto1.be] INFO: Saving data for TD70367: {'auction_closing_time': 1774714149.0, 'created_time': 1773920140.021664, 'last_price_update_time': 1774643877.822218}
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TD70367') HTTP/1.1" 204 0
2026-03-27 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_0c04bbfe0e601ada243a980ff5e8676c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:57 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-27 20:37:57 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-27 20:37:57 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS70966%27 HTTP/1.1" 200 None
2026-03-27 20:37:57 [auto1.be] INFO: Scrape type for VS70966: 1
2026-03-27 20:37:57 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-27 20:37:57 [auto1.be] INFO: Scrape type for SK81997: 2
2026-03-27 20:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-27 20:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with scrape type 2
2026-03-27 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with scrape type 2
2026-03-27 20:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56177e08-6d3d-5481-9f0b-adbc9eeaede2, identifier: SK81997
2026-03-27 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC83971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-27 20:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997
2026-03-27 20:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56177e08-6d3d-5481-9f0b-adbc9eeaede2 with identifier: SK81997 to the API
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:49Z',
 'fuel_type': 'diesel',
 'id': '56177e08-6d3d-5481-9f0b-adbc9eeaede2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK81997',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 169952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Volvo S60 2.0 D3 Linje Svart',
 'transmission': 'manual',
 'trim': 'Linje Svart',
 'year': 2018}
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-27 20:37:58 [auto1.be] INFO: Saving data for SK81997: {'auction_closing_time': 1774715269.0, 'created_time': 1773909335.342104, 'last_price_update_time': 1774643878.2839}
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK81997') HTTP/1.1" 204 0
2026-03-27 20:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_4d59c6aac01cc3a2f7487c8a4295d196.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:58 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-27 20:37:58 [auto1.be] INFO: Scrape type for PJ82537: 1
2026-03-27 20:37:58 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-27 20:37:58 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-27 20:37:58 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-27 20:37:58 [auto1.be] INFO: Scrape type for ZX32272: 2
2026-03-27 20:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-27 20:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with scrape type 2
2026-03-27 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with scrape type 2
2026-03-27 20:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3, identifier: ZX32272
2026-03-27 20:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ca7210>
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_cab76659845c0f6140a88bb592ebb0bd.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_cab76659845c0f6140a88bb592ebb0bd.jpg saved to cache
2026-03-27 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033a7410>
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_8779e883b7648c30f3674953b62d2000.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_8779e883b7648c30f3674953b62d2000.jpg saved to cache
2026-03-27 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-27 20:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272
2026-03-27 20:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c4ce64c-ca92-5a37-9b73-bc3a62b723e3 with identifier: ZX32272 to the API
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:05:02Z',
 'fuel_type': 'diesel',
 'id': '9c4ce64c-ca92-5a37-9b73-bc3a62b723e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX32272',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 163844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-27 20:37:58 [auto1.be] INFO: Saving data for ZX32272: {'auction_closing_time': 1774713902.0, 'created_time': 1773866672.228361, 'last_price_update_time': 1774643878.934545}
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX32272') HTTP/1.1" 204 0
2026-03-27 20:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_becf66d78a7751ea27a83b75121527c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_856729b7f8738796fe29d6b57e79a07d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:58 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-27 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for NP17382: 1
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for JB70681: 1
2026-03-27 20:37:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6fa50>
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_0c04bbfe0e601ada243a980ff5e8676c.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_0c04bbfe0e601ada243a980ff5e8676c.jpg saved to cache
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:37:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdc510>
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_4d59c6aac01cc3a2f7487c8a4295d196.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_4d59c6aac01cc3a2f7487c8a4295d196.jpg saved to cache
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for DM52841: 1
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for PS72966: 1
2026-03-27 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e745b70cc804f5df0002a844370e7ef6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_218d367c98e8dadfd0ae2285e6f80e60.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR03762%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for LR03762: 1
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for CC85070: 1
2026-03-27 20:37:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903105010>
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_becf66d78a7751ea27a83b75121527c8.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_becf66d78a7751ea27a83b75121527c8.jpg saved to cache
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031a4310>
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_856729b7f8738796fe29d6b57e79a07d.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_856729b7f8738796fe29d6b57e79a07d.jpg saved to cache
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH43502%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for HH43502: 1
2026-03-27 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET18736> (referer: https://www.auto1.com/v1/car-details-view/ET18736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:37:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903254650>
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_e745b70cc804f5df0002a844370e7ef6.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e745b70cc804f5df0002a844370e7ef6.jpg saved to cache
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:37:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903283550>
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_218d367c98e8dadfd0ae2285e6f80e60.jpg') HTTP/1.1" 204 0
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_218d367c98e8dadfd0ae2285e6f80e60.jpg saved to cache
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:37:59 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-27 20:37:59 [auto1.be] INFO: Scrape type for WE70666: 2
2026-03-27 20:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-27 20:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed47b16-c131-53a7-a3d0-b7cd0c941363 with scrape type 2
2026-03-27 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eed47b16-c131-53a7-a3d0-b7cd0c941363 with scrape type 2
2026-03-27 20:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eed47b16-c131-53a7-a3d0-b7cd0c941363, identifier: WE70666
2026-03-27 20:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-27 20:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666
2026-03-27 20:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eed47b16-c131-53a7-a3d0-b7cd0c941363 with identifier: WE70666 to the API
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:26Z',
 'fuel_type': 'petrol',
 'id': 'eed47b16-c131-53a7-a3d0-b7cd0c941363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE70666',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 71558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2019}
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Saving data for WE70666: {'auction_closing_time': 1774717106.0, 'created_time': 1773747359.176413, 'last_price_update_time': 1774643880.250473}
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE70666') HTTP/1.1" 204 0
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Scrape type for FS38787: 1
2026-03-27 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM32931/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK56681> (referer: https://www.auto1.com/v1/car-details-view/PK56681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Scrape type for ZZ47044: 1
2026-03-27 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-27 20:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3247b2e-7a95-55d9-9f26-c42622767438 with scrape type 1
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_f2d4a2f794968f8ac27e2f21128ff8db.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_f2d4a2f794968f8ac27e2f21128ff8db.jpg not downloaded yet
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Scrape type for DL17322: 1
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_911fa602b3d52292f4e82693c0f551b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_911fa602b3d52292f4e82693c0f551b0.jpg not downloaded yet
2026-03-27 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_88503113e9c7b93076e35dcac822144c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE21828%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Scrape type for CE21828: 1
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_64524c71c31f4d215c5d552eee82a558.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_64524c71c31f4d215c5d552eee82a558.jpg not downloaded yet
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR17508%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Scrape type for JR17508: 1
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_ee884d18256651b8d394328645be1567.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_ee884d18256651b8d394328645be1567.jpg not downloaded yet
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Scrape type for FE52220: 1
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_1f620d5b5d7c9b9cdae8b67d5df19d1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1f620d5b5d7c9b9cdae8b67d5df19d1c.jpg not downloaded yet
2026-03-27 20:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a3642dd-0a5f-52be-9ee7-227f38d0ad4d with identifier: PK56681
2026-03-27 20:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a3642dd-0a5f-52be-9ee7-227f38d0ad4d with scrape type 1
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a3642dd-0a5f-52be-9ee7-227f38d0ad4d
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_4cefe385befc29f1bc519b420eb4cfed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_4cefe385befc29f1bc519b420eb4cfed.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_bd765e131893ddfb6b6b7b5ff1477a3d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_bd765e131893ddfb6b6b7b5ff1477a3d.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_5724284241b7b32bb4311352a3c82a55.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_5724284241b7b32bb4311352a3c82a55.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_64832118ba0f61df13cb2afc0eb05476.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_64832118ba0f61df13cb2afc0eb05476.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_730ad99599406090545d95e0ba104463.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_730ad99599406090545d95e0ba104463.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_c06ff230dda5724d9f1a8d3b120e5857.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_c06ff230dda5724d9f1a8d3b120e5857.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_b323f41111c4a80b19479be56597d843.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_b323f41111c4a80b19479be56597d843.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_8fad5a20bf3ff0a65b52eaec8772787b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_8fad5a20bf3ff0a65b52eaec8772787b.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_549fa84eb4e565c7ba52a1316e06afc8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_549fa84eb4e565c7ba52a1316e06afc8.jpg already downloaded
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F98%252Fb898fea686e7ca81bcb924c6d4d95c0e%252Fpa%252FPK56681_b5a5c053ff1fc06b7c670ef0542bbe05.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_b5a5c053ff1fc06b7c670ef0542bbe05.jpg already downloaded
2026-03-27 20:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a3642dd-0a5f-52be-9ee7-227f38d0ad4d, identifier: PK56681
2026-03-27 20:38:00 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [auto1.be] INFO: Scrape type for YL00049: 1
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_682848de2d961fa10637f22788bba396.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_682848de2d961fa10637f22788bba396.jpg not downloaded yet
2026-03-27 20:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a3642dd-0a5f-52be-9ee7-227f38d0ad4d with identifier: PK56681
2026-03-27 20:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a3642dd-0a5f-52be-9ee7-227f38d0ad4d with identifier: PK56681
2026-03-27 20:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a3642dd-0a5f-52be-9ee7-227f38d0ad4d with identifier: PK56681 to the API
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK56681>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:58:38Z',
 'fuel_type': 'diesel',
 'id': '0a3642dd-0a5f-52be-9ee7-227f38d0ad4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK56681',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 147929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_4cefe385befc29f1bc519b420eb4cfed.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_bd765e131893ddfb6b6b7b5ff1477a3d.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_5724284241b7b32bb4311352a3c82a55.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_64832118ba0f61df13cb2afc0eb05476.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_730ad99599406090545d95e0ba104463.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_c06ff230dda5724d9f1a8d3b120e5857.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_b323f41111c4a80b19479be56597d843.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_8fad5a20bf3ff0a65b52eaec8772787b.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_549fa84eb4e565c7ba52a1316e06afc8.jpg',
                'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_b5a5c053ff1fc06b7c670ef0542bbe05.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48965,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_4cefe385befc29f1bc519b420eb4cfed.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48542,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_bd765e131893ddfb6b6b7b5ff1477a3d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45125,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_5724284241b7b32bb4311352a3c82a55.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41184,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_64832118ba0f61df13cb2afc0eb05476.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40687,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_730ad99599406090545d95e0ba104463.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_c06ff230dda5724d9f1a8d3b120e5857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_b323f41111c4a80b19479be56597d843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_8fad5a20bf3ff0a65b52eaec8772787b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47568,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_549fa84eb4e565c7ba52a1316e06afc8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a3642dd-0a5f-52be-9ee7-227f38d0ad4d/0a3642dd-0a5f-52be-9ee7-227f38d0ad4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/98/b898fea686e7ca81bcb924c6d4d95c0e/pa/PK56681_b5a5c053ff1fc06b7c670ef0542bbe05.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Note 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK56681%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Saving data for PK56681: {'created_time': 1774643881.268172, 'last_price_update_time': 1774643881.268181, 'auction_closing_time': 1774717118.0}
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK56681') HTTP/1.1" 204 0
2026-03-27 20:38:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c7e610>
2026-03-27 20:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_88503113e9c7b93076e35dcac822144c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_88503113e9c7b93076e35dcac822144c.jpg saved to cache
2026-03-27 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for HD96937: 1
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_6307f43b103815bb418d6491e3b49fb6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_6307f43b103815bb418d6491e3b49fb6.jpg not downloaded yet
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for YP74524: 1
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_1ae260813ca9d821fbb16f73f375fe82.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1ae260813ca9d821fbb16f73f375fe82.jpg not downloaded yet
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for TX40265: 1
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_d10854ed5d6d34f80c9b217362272430.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_d10854ed5d6d34f80c9b217362272430.jpg not downloaded yet
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for CK64923: 1
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_315fb2ce33f412f4ac0546cfb5933c19.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_315fb2ce33f412f4ac0546cfb5933c19.jpg not downloaded yet
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for RK88808: 1
2026-03-27 20:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_851f7f4d16b89a416bfccd221b955d09.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS34473%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for MS34473: 1
2026-03-27 20:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_54be774d4d40c3ff5704126d9a2ea7af.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for XC82229: 1
2026-03-27 20:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_1d27a241e8f7be3d0e8b7164f9526457.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:01 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-27 20:38:01 [auto1.be] INFO: Scrape type for FA30680: 2
2026-03-27 20:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-27 20:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc0c507-bfc5-5a88-b516-bd9145a3f34b with scrape type 2
2026-03-27 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcc0c507-bfc5-5a88-b516-bd9145a3f34b with scrape type 2
2026-03-27 20:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcc0c507-bfc5-5a88-b516-bd9145a3f34b, identifier: FA30680
2026-03-27 20:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-27 20:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680
2026-03-27 20:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcc0c507-bfc5-5a88-b516-bd9145a3f34b with identifier: FA30680 to the API
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:02Z',
 'fuel_type': 'petrol',
 'id': 'dcc0c507-bfc5-5a88-b516-bd9145a3f34b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA30680',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 51850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-17',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2023}
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-27 20:38:02 [auto1.be] INFO: Saving data for FA30680: {'auction_closing_time': 1774714922.0, 'created_time': 1773780035.362044, 'last_price_update_time': 1774643882.085351}
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA30680') HTTP/1.1" 204 0
2026-03-27 20:38:02 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-27 20:38:02 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-27 20:38:02 [auto1.be] INFO: Scrape type for EF70909: 2
2026-03-27 20:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-27 20:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89689ae0-27af-5545-bbd7-6643c93415f9 with scrape type 2
2026-03-27 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89689ae0-27af-5545-bbd7-6643c93415f9 with scrape type 2
2026-03-27 20:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89689ae0-27af-5545-bbd7-6643c93415f9, identifier: EF70909
2026-03-27 20:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-27 20:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909
2026-03-27 20:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89689ae0-27af-5545-bbd7-6643c93415f9 with identifier: EF70909 to the API
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:25:41Z',
 'fuel_type': 'petrol',
 'id': '89689ae0-27af-5545-bbd7-6643c93415f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF70909',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 93238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-27 20:38:02 [auto1.be] INFO: Saving data for EF70909: {'auction_closing_time': 1774715141.0, 'created_time': 1773909340.992138, 'last_price_update_time': 1774643882.549473}
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EF70909') HTTP/1.1" 204 0
2026-03-27 20:38:02 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-27 20:38:02 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-27 20:38:02 [auto1.be] INFO: Scrape type for RU10603: 1
2026-03-27 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM52841/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH43502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR03762/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP17382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eefb10>
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_851f7f4d16b89a416bfccd221b955d09.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_851f7f4d16b89a416bfccd221b955d09.jpg saved to cache
2026-03-27 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:38:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903392290>
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_54be774d4d40c3ff5704126d9a2ea7af.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_54be774d4d40c3ff5704126d9a2ea7af.jpg saved to cache
2026-03-27 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:38:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e64d0>
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_1d27a241e8f7be3d0e8b7164f9526457.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_1d27a241e8f7be3d0e8b7164f9526457.jpg saved to cache
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB70681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_b2998987ca07d017344aa21cb4a623af.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:03 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-27 20:38:03 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-27 20:38:03 [auto1.be] INFO: Scrape type for VB55746: 1
2026-03-27 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS72966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC83971> (referer: https://www.auto1.com/v1/car-details-view/JC83971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_a963916f27da309e777b2c29da99c20d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_f2d4a2f794968f8ac27e2f21128ff8db.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_315fb2ce33f412f4ac0546cfb5933c19.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903264410>
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_b2998987ca07d017344aa21cb4a623af.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_b2998987ca07d017344aa21cb4a623af.jpg saved to cache
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013e4bd8-23e1-5e52-bc1e-18616a6a3c1b with identifier: JC83971
2026-03-27 20:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013e4bd8-23e1-5e52-bc1e-18616a6a3c1b with scrape type 1
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 013e4bd8-23e1-5e52-bc1e-18616a6a3c1b
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F22%252F0322d64df684ca2271fbe050b67b53c6%252Fpa%252FJC83971_e32899713761550f38204e04ba84bf85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_e32899713761550f38204e04ba84bf85.jpg already downloaded
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F22%252F0322d64df684ca2271fbe050b67b53c6%252Fpa%252FJC83971_8fdef4fab94467e8d514c0ad4f070648.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_8fdef4fab94467e8d514c0ad4f070648.jpg already downloaded
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F22%252F0322d64df684ca2271fbe050b67b53c6%252Fpa%252FJC83971_0ef3949cd02df0a018d379011fc9a43d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_0ef3949cd02df0a018d379011fc9a43d.jpg already downloaded
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F22%252F0322d64df684ca2271fbe050b67b53c6%252Fpa%252FJC83971_4eb023db5585a6268b45aae28b572d2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_4eb023db5585a6268b45aae28b572d2d.jpg already downloaded
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F22%252F0322d64df684ca2271fbe050b67b53c6%252Fpa%252FJC83971_8ec7340084239cb340da3b9041077e3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_8ec7340084239cb340da3b9041077e3e.jpg already downloaded
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F22%252F0322d64df684ca2271fbe050b67b53c6%252Fpa%252FJC83971_579a1278c8f7f18e14de08b05e9773ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_579a1278c8f7f18e14de08b05e9773ca.jpg already downloaded
2026-03-27 20:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 013e4bd8-23e1-5e52-bc1e-18616a6a3c1b, identifier: JC83971
2026-03-27 20:38:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903112810>
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_a963916f27da309e777b2c29da99c20d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_a963916f27da309e777b2c29da99c20d.jpg saved to cache
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:38:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903228550>
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_f2d4a2f794968f8ac27e2f21128ff8db.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_f2d4a2f794968f8ac27e2f21128ff8db.jpg saved to cache
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903263d90>
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_315fb2ce33f412f4ac0546cfb5933c19.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_315fb2ce33f412f4ac0546cfb5933c19.jpg saved to cache
2026-03-27 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 013e4bd8-23e1-5e52-bc1e-18616a6a3c1b with identifier: JC83971
2026-03-27 20:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 013e4bd8-23e1-5e52-bc1e-18616a6a3c1b with identifier: JC83971
2026-03-27 20:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 013e4bd8-23e1-5e52-bc1e-18616a6a3c1b with identifier: JC83971 to the API
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC83971>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:41:12Z',
 'fuel_type': 'diesel',
 'id': '013e4bd8-23e1-5e52-bc1e-18616a6a3c1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC83971',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 187972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_e32899713761550f38204e04ba84bf85.jpg',
                'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_8fdef4fab94467e8d514c0ad4f070648.jpg',
                'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_0ef3949cd02df0a018d379011fc9a43d.jpg',
                'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_4eb023db5585a6268b45aae28b572d2d.jpg',
                'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_8ec7340084239cb340da3b9041077e3e.jpg',
                'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_579a1278c8f7f18e14de08b05e9773ca.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_013e4bd8-23e1-5e52-bc1e-18616a6a3c1b/013e4bd8-23e1-5e52-bc1e-18616a6a3c1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_e32899713761550f38204e04ba84bf85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_013e4bd8-23e1-5e52-bc1e-18616a6a3c1b/013e4bd8-23e1-5e52-bc1e-18616a6a3c1b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_8fdef4fab94467e8d514c0ad4f070648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_013e4bd8-23e1-5e52-bc1e-18616a6a3c1b/013e4bd8-23e1-5e52-bc1e-18616a6a3c1b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_0ef3949cd02df0a018d379011fc9a43d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_013e4bd8-23e1-5e52-bc1e-18616a6a3c1b/013e4bd8-23e1-5e52-bc1e-18616a6a3c1b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_4eb023db5585a6268b45aae28b572d2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_013e4bd8-23e1-5e52-bc1e-18616a6a3c1b/013e4bd8-23e1-5e52-bc1e-18616a6a3c1b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_8ec7340084239cb340da3b9041077e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_013e4bd8-23e1-5e52-bc1e-18616a6a3c1b/013e4bd8-23e1-5e52-bc1e-18616a6a3c1b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/22/0322d64df684ca2271fbe050b67b53c6/pa/JC83971_579a1278c8f7f18e14de08b05e9773ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Envy',
 'transmission': 'manual',
 'trim': 'Envy',
 'year': 2011}
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC83971%27 HTTP/1.1" 200 None
2026-03-27 20:38:04 [auto1.be] INFO: Saving data for JC83971: {'created_time': 1774643884.22718, 'last_price_update_time': 1774643884.227191, 'auction_closing_time': 1774716072.0}
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC83971') HTTP/1.1" 204 0
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_6307f43b103815bb418d6491e3b49fb6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1ae260813ca9d821fbb16f73f375fe82.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_d10854ed5d6d34f80c9b217362272430.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e12d0>
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_6307f43b103815bb418d6491e3b49fb6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_6307f43b103815bb418d6491e3b49fb6.jpg saved to cache
2026-03-27 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c5e4d0>
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_1ae260813ca9d821fbb16f73f375fe82.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1ae260813ca9d821fbb16f73f375fe82.jpg saved to cache
2026-03-27 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdf690>
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_d10854ed5d6d34f80c9b217362272430.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_d10854ed5d6d34f80c9b217362272430.jpg saved to cache
2026-03-27 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK88808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK64923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS34473/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC82229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU10603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS38787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_682848de2d961fa10637f22788bba396.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1f620d5b5d7c9b9cdae8b67d5df19d1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e4050>
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_682848de2d961fa10637f22788bba396.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_682848de2d961fa10637f22788bba396.jpg saved to cache
2026-03-27 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f8210>
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_1f620d5b5d7c9b9cdae8b67d5df19d1c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1f620d5b5d7c9b9cdae8b67d5df19d1c.jpg saved to cache
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:08 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 99 pages/min), scraped 201 items (at 96 items/min)
2026-03-27 20:38:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-27 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR03762> (referer: https://www.auto1.com/v1/car-details-view/LR03762/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX40265/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB70681> (referer: https://www.auto1.com/v1/car-details-view/JB70681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS72966> (referer: https://www.auto1.com/v1/car-details-view/PS72966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP74524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP17382> (referer: https://www.auto1.com/v1/car-details-view/NP17382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ82537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eeceb52-402f-5d63-9f0c-86a76fd0ac08 with identifier: LR03762
2026-03-27 20:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08 with scrape type 1
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_7c70089d6f50ab9513df37f1d8203717.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7c70089d6f50ab9513df37f1d8203717.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_534e5f33f08f90e37e49e4afb5b36735.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_534e5f33f08f90e37e49e4afb5b36735.jpg not downloaded yet
2026-03-27 20:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-27 20:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with scrape type 1
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_41286feced46a0a6e17ac4bbb340173b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_41286feced46a0a6e17ac4bbb340173b.jpg not downloaded yet
2026-03-27 20:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-27 20:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfac3745-102b-5e51-88ec-ce03459d40c5 with scrape type 1
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_fcf1cfcb6c1905114b25e4d2a1383f41.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fcf1cfcb6c1905114b25e4d2a1383f41.jpg not downloaded yet
2026-03-27 20:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-27 20:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with scrape type 1
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_8f3de5ba5221950da1a406046bb10dad.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8f3de5ba5221950da1a406046bb10dad.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_b674baa16c839ced556f3abd2d02d495.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_b674baa16c839ced556f3abd2d02d495.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_202d840f0dda5c7df46f69e9ce9e534c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_202d840f0dda5c7df46f69e9ce9e534c.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_02fb239cc80201eaad58742065c63b0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_02fb239cc80201eaad58742065c63b0e.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_41e6c4128b3584a75d3c361c26b755a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_41e6c4128b3584a75d3c361c26b755a4.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_7dc6cfb285c4c4f9989a7463e024af72.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7dc6cfb285c4c4f9989a7463e024af72.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_a949234e6353cbf8922dfb00235b1d96.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a949234e6353cbf8922dfb00235b1d96.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_af5e0df0e5ad39a28bdd3169f3cb9b2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_af5e0df0e5ad39a28bdd3169f3cb9b2e.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_932ef65b871392eac41ac8295a16e063.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_932ef65b871392eac41ac8295a16e063.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_141e62feceafd8b7525a37866be5c8d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_141e62feceafd8b7525a37866be5c8d8.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_8a8227734ee4b57817798219297b260b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_8a8227734ee4b57817798219297b260b.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_c4e61eb86e95a935b269c6a466be368f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_c4e61eb86e95a935b269c6a466be368f.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_bd36e29d0ce292e413deea6b064c962b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_bd36e29d0ce292e413deea6b064c962b.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_4bff16c86dfff2c2eb7c1fbb9c616986.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_4bff16c86dfff2c2eb7c1fbb9c616986.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_a682afaa42f5c1bd21a511948cb54b05.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a682afaa42f5c1bd21a511948cb54b05.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_63bb819bb2b937e1f5d618514c14b9f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_63bb819bb2b937e1f5d618514c14b9f6.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_7f8f06d9d7ffc1fb26b793899adecf97.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_7f8f06d9d7ffc1fb26b793899adecf97.jpg not downloaded yet
2026-03-27 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_d43f35693131ba7e27c4ff3c0b739adb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_d43f35693131ba7e27c4ff3c0b739adb.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_67acc03506cd3cf3d832d22b95703c55.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_67acc03506cd3cf3d832d22b95703c55.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_e5089b58cca32340eb4b980235fc726f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_e5089b58cca32340eb4b980235fc726f.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_b16efb239b4bae48be80f891a2dddf46.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_b16efb239b4bae48be80f891a2dddf46.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_e22b120cb84b4d591f2d4f683cb28985.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_e22b120cb84b4d591f2d4f683cb28985.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_342cfa9428eb7321fe79a061361556fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_342cfa9428eb7321fe79a061361556fe.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_034f552bb3c60f359fe1885967340273.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_034f552bb3c60f359fe1885967340273.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_a12019f04dd043d1449248ce3c1cb97e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_a12019f04dd043d1449248ce3c1cb97e.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_283de8355876a1ecdfaed62c8cd19ebc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_283de8355876a1ecdfaed62c8cd19ebc.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_fa64a0a35a2b66f208aceceb5df12e24.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_fa64a0a35a2b66f208aceceb5df12e24.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_fb95633d4ccf3c245fb40e22d89d2f19.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fb95633d4ccf3c245fb40e22d89d2f19.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_8afbabced8ad2837964502d1704b0ae7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8afbabced8ad2837964502d1704b0ae7.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_698e009846fe3bbc5f75b089c7d408fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_698e009846fe3bbc5f75b089c7d408fb.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_71614a7ef9465cab65c9e98c9843799c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_71614a7ef9465cab65c9e98c9843799c.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_9fc168286e4932708e64a20e1e609109.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_9fc168286e4932708e64a20e1e609109.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_37e002e017173e1f16c9b8c10e1b3e44.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_37e002e017173e1f16c9b8c10e1b3e44.jpg not downloaded yet
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC85070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_2e7e61b77670855b9bf7492453aa84a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_2e7e61b77670855b9bf7492453aa84a0.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_550f035295e9be826aee9dd312539d09.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_550f035295e9be826aee9dd312539d09.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_47898c58b2b8a55515d44960fae9e9e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_47898c58b2b8a55515d44960fae9e9e8.jpg not downloaded yet
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB55746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_ee884d18256651b8d394328645be1567.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD96937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_2e7e61b77670855b9bf7492453aa84a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032c8950>
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_ee884d18256651b8d394328645be1567.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_ee884d18256651b8d394328645be1567.jpg saved to cache
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM52841> (referer: https://www.auto1.com/v1/car-details-view/DM52841/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU10603> (referer: https://www.auto1.com/v1/car-details-view/RU10603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH43502> (referer: https://www.auto1.com/v1/car-details-view/HH43502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dc1950>
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_2e7e61b77670855b9bf7492453aa84a0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_2e7e61b77670855b9bf7492453aa84a0.jpg saved to cache
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM32931> (referer: https://www.auto1.com/v1/car-details-view/RM32931/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-27 20:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78477a3c-a638-585c-8cb2-230e49297ede with scrape type 1
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 78477a3c-a638-585c-8cb2-230e49297ede
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_911192b43ee5b2c126d05aea470a72e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_911192b43ee5b2c126d05aea470a72e3.jpg not downloaded yet
2026-03-27 20:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-27 20:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8508898-f2f2-5c2f-af7f-49a19194831b with scrape type 1
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_cc8c4cd6cca1069aee097cebde3f718f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_cc8c4cd6cca1069aee097cebde3f718f.jpg not downloaded yet
2026-03-27 20:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11841c30-afee-5ca2-9fe8-83ac77b862ea with identifier: HH43502
2026-03-27 20:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11841c30-afee-5ca2-9fe8-83ac77b862ea with scrape type 1
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_958a1831e11eadf6a1284987cc70c502.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_958a1831e11eadf6a1284987cc70c502.jpg not downloaded yet
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_047192eabf316d709ba588da1995a744.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_047192eabf316d709ba588da1995a744.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_d8602eacf104a405a0c8adab15558f48.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d8602eacf104a405a0c8adab15558f48.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_5ee372135684214f42e65f0cba13f7ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ee372135684214f42e65f0cba13f7ef.jpg not downloaded yet
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_9fc168286e4932708e64a20e1e609109.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_71614a7ef9465cab65c9e98c9843799c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL00049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_e1cb4f63ba83258f7c134cee22afcc28.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_e1cb4f63ba83258f7c134cee22afcc28.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_f40c1847362f1f36452e9dc78ad3a832.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_f40c1847362f1f36452e9dc78ad3a832.jpg not downloaded yet
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_5ce3fab53a5226a04042f5d4ae11daee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ce3fab53a5226a04042f5d4ae11daee.jpg not downloaded yet
2026-03-27 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_926345b687682108575bc3da5e674a03.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_926345b687682108575bc3da5e674a03.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_d456ed9de3d379b883bcd3da4d87b52d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d456ed9de3d379b883bcd3da4d87b52d.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_4bfa2e0e579ed5806bccef19b3d600a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_4bfa2e0e579ed5806bccef19b3d600a1.jpg not downloaded yet
2026-03-27 20:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-27 20:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with scrape type 1
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_ac397578061ab4d2a1cb22042a298486.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_ac397578061ab4d2a1cb22042a298486.jpg not downloaded yet
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f857d0>
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_9fc168286e4932708e64a20e1e609109.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_9fc168286e4932708e64a20e1e609109.jpg saved to cache
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033facd0>
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_71614a7ef9465cab65c9e98c9843799c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_71614a7ef9465cab65c9e98c9843799c.jpg saved to cache
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d8602eacf104a405a0c8adab15558f48.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ee372135684214f42e65f0cba13f7ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_cb129a9fa89b98f35f80f2c362811aa4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_cb129a9fa89b98f35f80f2c362811aa4.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_3903c2ea5cdedc55a4fd9d89eeec2390.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_3903c2ea5cdedc55a4fd9d89eeec2390.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_fde78ba7253e3716efe6e33d16a19d62.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_fde78ba7253e3716efe6e33d16a19d62.jpg not downloaded yet
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_047192eabf316d709ba588da1995a744.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_8a92026ac72dc8459744deee46a429da.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_8a92026ac72dc8459744deee46a429da.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_4ba1216a39c3dae1573ad05312df4f76.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_4ba1216a39c3dae1573ad05312df4f76.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_2e6e6aea08a8744cce15315cd468b00b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_2e6e6aea08a8744cce15315cd468b00b.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_937018b1fd9f4066490eed4adcd7aa85.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_937018b1fd9f4066490eed4adcd7aa85.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_19afa0a7e5482ef997362e2f2075fc53.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_19afa0a7e5482ef997362e2f2075fc53.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_ed2f93278ab116e52f4ec5a510ee7542.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_ed2f93278ab116e52f4ec5a510ee7542.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_453e8847b29c4e9b34f3cae08b281d6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_453e8847b29c4e9b34f3cae08b281d6e.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_2239c65bc2eff7547d7d4e03e8f5e75c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_2239c65bc2eff7547d7d4e03e8f5e75c.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_dcbec3b961e24d42b6776dfe686c94a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_dcbec3b961e24d42b6776dfe686c94a7.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_b1230cb164308a7a835d881d8f7ba833.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_b1230cb164308a7a835d881d8f7ba833.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_0ea2749b911e68c6cb7c5243406261d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_0ea2749b911e68c6cb7c5243406261d1.jpg not downloaded yet
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dc1950>
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_d8602eacf104a405a0c8adab15558f48.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d8602eacf104a405a0c8adab15558f48.jpg saved to cache
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e5850>
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_5ee372135684214f42e65f0cba13f7ef.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ee372135684214f42e65f0cba13f7ef.jpg saved to cache
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b1810>
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_047192eabf316d709ba588da1995a744.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_047192eabf316d709ba588da1995a744.jpg saved to cache
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78477a3c-a638-585c-8cb2-230e49297ede
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_4bfa2e0e579ed5806bccef19b3d600a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_896542e98a570c17a1f9ac340c3156ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_896542e98a570c17a1f9ac340c3156ec.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_cab0ade73fe9a9585c39d0578c39f97c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_cab0ade73fe9a9585c39d0578c39f97c.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_329c149341974c66fdd6348c2ebb2736.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_329c149341974c66fdd6348c2ebb2736.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_6525db8171abc22d445b181f44cde4f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_6525db8171abc22d445b181f44cde4f8.jpg not downloaded yet
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_9bea6193020cc4ab41274ed756878d36.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_9bea6193020cc4ab41274ed756878d36.jpg not downloaded yet
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC82229> (referer: https://www.auto1.com/v1/car-details-view/XC82229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_24508f70e33b05b9393e1fc3821b9c64.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_24508f70e33b05b9393e1fc3821b9c64.jpg not downloaded yet
2026-03-27 20:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS38787> (referer: https://www.auto1.com/v1/car-details-view/FS38787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_37e002e017173e1f16c9b8c10e1b3e44.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_e22ac2eaf9b643bf9dcdeb4e0e7f1b08.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_e22ac2eaf9b643bf9dcdeb4e0e7f1b08.jpg not downloaded yet
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK64923> (referer: https://www.auto1.com/v1/car-details-view/CK64923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_a9f897dfcb48d12bb31f53b18e9f460a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a9f897dfcb48d12bb31f53b18e9f460a.jpg not downloaded yet
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031c1090>
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_4bfa2e0e579ed5806bccef19b3d600a1.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_4bfa2e0e579ed5806bccef19b3d600a1.jpg saved to cache
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_a0cab73be5f9d4c2fe8652569e132bc0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a0cab73be5f9d4c2fe8652569e132bc0.jpg not downloaded yet
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK88808> (referer: https://www.auto1.com/v1/car-details-view/RK88808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS34473> (referer: https://www.auto1.com/v1/car-details-view/MS34473/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-27 20:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702e2a30-4411-5c01-9d91-776d01caa249 with scrape type 1
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_7129fcbb038ca304971458ab7450419b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7129fcbb038ca304971458ab7450419b.jpg not downloaded yet
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_550f035295e9be826aee9dd312539d09.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_9bea6193020cc4ab41274ed756878d36.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_ad87dfda33cd16d4ac1c06c620afcb3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_ad87dfda33cd16d4ac1c06c620afcb3b.jpg not downloaded yet
2026-03-27 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE52220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-27 20:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b492033-8422-51be-bbf0-0322a3f6da80 with scrape type 1
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_26398752bd92f895211922048790ebef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26398752bd92f895211922048790ebef.jpg not downloaded yet
2026-03-27 20:38:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce8890>
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_37e002e017173e1f16c9b8c10e1b3e44.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_37e002e017173e1f16c9b8c10e1b3e44.jpg saved to cache
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923
2026-03-27 20:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bbcac9-be80-5f93-8a33-7618fc30eab6 with scrape type 1
2026-03-27 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_d62528e86e2d95699ea3d72ac221654c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d62528e86e2d95699ea3d72ac221654c.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_4f670bba5b8cc6f56aabf242fc032355.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_4f670bba5b8cc6f56aabf242fc032355.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_880a6eadfd4e1da02c0e028be18c92a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_880a6eadfd4e1da02c0e028be18c92a2.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_39ee54486110fbb8adbc321c615c6075.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_39ee54486110fbb8adbc321c615c6075.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_d5b14bea56f6fe18eeda20bb2e0039fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_d5b14bea56f6fe18eeda20bb2e0039fa.jpg not downloaded yet
2026-03-27 20:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808
2026-03-27 20:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with scrape type 1
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_1712a0fa17e4ffbd8c6f4fecbfdff4b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_1712a0fa17e4ffbd8c6f4fecbfdff4b3.jpg not downloaded yet
2026-03-27 20:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc with identifier: MS34473
2026-03-27 20:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc with scrape type 1
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_200421a23cc1d82b5d23c5fe07ad7932.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_200421a23cc1d82b5d23c5fe07ad7932.jpg not downloaded yet
2026-03-27 20:38:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c6c0d0>
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_550f035295e9be826aee9dd312539d09.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_550f035295e9be826aee9dd312539d09.jpg saved to cache
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90330cc50>
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_9bea6193020cc4ab41274ed756878d36.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_9bea6193020cc4ab41274ed756878d36.jpg saved to cache
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_0d512f50c10c8490bce695217ebaf421.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_0d512f50c10c8490bce695217ebaf421.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_cf70ab49893c240d09ec22b2c93c9c3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_cf70ab49893c240d09ec22b2c93c9c3b.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_02f803ef9eeb3cb67bef49ffe6d9cae3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_02f803ef9eeb3cb67bef49ffe6d9cae3.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_42c70afce90241ff927dda68a69599fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_42c70afce90241ff927dda68a69599fd.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_4a600db436e7c53c5d2206f4800fe6f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_4a600db436e7c53c5d2206f4800fe6f3.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_b751fba72a5fc7cf49023514e123cd67.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b751fba72a5fc7cf49023514e123cd67.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_d15e440d9957f41323a39e8fecba0095.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d15e440d9957f41323a39e8fecba0095.jpg not downloaded yet
2026-03-27 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR17508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_7929b878efb794e0ea4376dd80a645dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7929b878efb794e0ea4376dd80a645dd.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_f34e8147aaf5cec344366e3a37138ff0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_f34e8147aaf5cec344366e3a37138ff0.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_f0ab58f371e24cb5ef167cd2095edc15.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_f0ab58f371e24cb5ef167cd2095edc15.jpg not downloaded yet
2026-03-27 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB55746> (referer: https://www.auto1.com/v1/car-details-view/VB55746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_674d4798cb31b3b5be2f960ced176813.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_674d4798cb31b3b5be2f960ced176813.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_ade7cdfdbc8d0401242199a15b74c9a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_ade7cdfdbc8d0401242199a15b74c9a2.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_3963afe0417e92b62c23b0686f29b6e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_3963afe0417e92b62c23b0686f29b6e6.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_95b36de3c664faa41709330225c29701.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_95b36de3c664faa41709330225c29701.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_ed2fbb97f70849c7e15a0d487104bece.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ed2fbb97f70849c7e15a0d487104bece.jpg not downloaded yet
2026-03-27 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_39ee54486110fbb8adbc321c615c6075.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_b88722b00d76c77a7faf913b7030ac96.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b88722b00d76c77a7faf913b7030ac96.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_0b22996966621cc697332b389410dd4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_0b22996966621cc697332b389410dd4c.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_6d36c4b0ea08e213b43de4b93be30648.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6d36c4b0ea08e213b43de4b93be30648.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_0123765466b9b8038c034eef88be29b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0123765466b9b8038c034eef88be29b6.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_96f659b95bf5c6e702aa7cf490ea7630.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_96f659b95bf5c6e702aa7cf490ea7630.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_1acad3f080ce12d998631ea59d519afe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_1acad3f080ce12d998631ea59d519afe.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_449b1b505b7a94300ece45a043c5ed3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_449b1b505b7a94300ece45a043c5ed3c.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_832044a273838fc07c7cae36ae62bf32.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_832044a273838fc07c7cae36ae62bf32.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_9ceca6285e627f6539972226673bc616.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_9ceca6285e627f6539972226673bc616.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_ba0f062e0bb308453779ef8f1686fcde.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ba0f062e0bb308453779ef8f1686fcde.jpg not downloaded yet
2026-03-27 20:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-27 20:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with scrape type 1
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2e5d416c6b600cef3969a830ab6fdea8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2e5d416c6b600cef3969a830ab6fdea8.jpg not downloaded yet
2026-03-27 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_47898c58b2b8a55515d44960fae9e9e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_5ffb17cd569561b099a68584c4838436.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_5ffb17cd569561b099a68584c4838436.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_439205d903a8a57fa8f67e702c9c1b6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_439205d903a8a57fa8f67e702c9c1b6e.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_6ab57d8aea8055cba9d11abf61df9404.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6ab57d8aea8055cba9d11abf61df9404.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_5b0c7e0d62eee4a6c63a1ccb12982087.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_5b0c7e0d62eee4a6c63a1ccb12982087.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_c60e3a3f26d92363d0e2befe4831fcab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_c60e3a3f26d92363d0e2befe4831fcab.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_33adabb2d282df40babbaefc86915561.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_33adabb2d282df40babbaefc86915561.jpg not downloaded yet
2026-03-27 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_4f670bba5b8cc6f56aabf242fc032355.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_844815861fd9b65854c59b5e3272099c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_844815861fd9b65854c59b5e3272099c.jpg not downloaded yet
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_90a138ae7253e981b9aa9ffec321a9ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_90a138ae7253e981b9aa9ffec321a9ee.jpg not downloaded yet
2026-03-27 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC85070> (referer: https://www.auto1.com/v1/car-details-view/CC85070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90331d7d0>
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_39ee54486110fbb8adbc321c615c6075.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_39ee54486110fbb8adbc321c615c6075.jpg saved to cache
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_2501da482d527529294a11b649fef800.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_2501da482d527529294a11b649fef800.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_318eb9d8323bd609257ea2f1ab948d1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_318eb9d8323bd609257ea2f1ab948d1c.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_0347d38870cd2f7d9fade9b29a3d0fea.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_0347d38870cd2f7d9fade9b29a3d0fea.jpg not downloaded yet
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d62528e86e2d95699ea3d72ac221654c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_26d27b588c2d74a4cb944b27080cb64e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26d27b588c2d74a4cb944b27080cb64e.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_b98b629c36f6ec9858d05ddb7b0922a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_b98b629c36f6ec9858d05ddb7b0922a9.jpg not downloaded yet
2026-03-27 20:38:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031dc190>
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_47898c58b2b8a55515d44960fae9e9e8.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_47898c58b2b8a55515d44960fae9e9e8.jpg saved to cache
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_0071ff573d0bc1cf6fb0d8a444ee6ba5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0071ff573d0bc1cf6fb0d8a444ee6ba5.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_ae25b39b31d500bbdea600bac32ae19f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ae25b39b31d500bbdea600bac32ae19f.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_815d367a4b5bc638a7386f6a6734f94e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_815d367a4b5bc638a7386f6a6734f94e.jpg not downloaded yet
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d78dd0>
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_4f670bba5b8cc6f56aabf242fc032355.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_4f670bba5b8cc6f56aabf242fc032355.jpg saved to cache
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-27 20:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d62c776-1845-5548-aec3-c1ce832c593e with scrape type 1
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_523b3a97abf3d87928e8efdd5ffd7e82.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_523b3a97abf3d87928e8efdd5ffd7e82.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_341eab0ac728a3af9fed697ab7b0eb2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_341eab0ac728a3af9fed697ab7b0eb2f.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_e6ff8c788831876da27b4b5a16033a3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_e6ff8c788831876da27b4b5a16033a3b.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2a3fe3808599bee8bcb2045701260bda.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2a3fe3808599bee8bcb2045701260bda.jpg not downloaded yet
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90324f490>
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_d62528e86e2d95699ea3d72ac221654c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d62528e86e2d95699ea3d72ac221654c.jpg saved to cache
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d15e440d9957f41323a39e8fecba0095.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_80948b368bbfa4abf4a67e287b79059a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_80948b368bbfa4abf4a67e287b79059a.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_cbddff9d3bedb4f765fb9d2ac9c7e116.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_cbddff9d3bedb4f765fb9d2ac9c7e116.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_0fe35ef8d9b21679a9805b0aebc612a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0fe35ef8d9b21679a9805b0aebc612a6.jpg not downloaded yet
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_ac397578061ab4d2a1cb22042a298486.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_407f029cee025eefeb6c7265013a9be1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_407f029cee025eefeb6c7265013a9be1.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_37e2510d74a6f8ac30bf3b91e14d499a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_37e2510d74a6f8ac30bf3b91e14d499a.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_4929bc205ec6d996592335d0e157a931.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_4929bc205ec6d996592335d0e157a931.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_0dee9ae772038fc9f5e59f941f2192d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0dee9ae772038fc9f5e59f941f2192d8.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2dc3951f6d5ec000407e92f20cbb9c9e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2dc3951f6d5ec000407e92f20cbb9c9e.jpg not downloaded yet
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_28a65575f12210792eb4438438fd732a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_28a65575f12210792eb4438438fd732a.jpg not downloaded yet
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e8c90>
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_d15e440d9957f41323a39e8fecba0095.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d15e440d9957f41323a39e8fecba0095.jpg saved to cache
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_6525db8171abc22d445b181f44cde4f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2643d244029f2e57ccace224e17ee0a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2643d244029f2e57ccace224e17ee0a0.jpg not downloaded yet
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_0ea2749b911e68c6cb7c5243406261d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_1fd8cee75214d8d48a195399bdcb8d73.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_1fd8cee75214d8d48a195399bdcb8d73.jpg not downloaded yet
2026-03-27 20:38:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903346250>
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_ac397578061ab4d2a1cb22042a298486.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_ac397578061ab4d2a1cb22042a298486.jpg saved to cache
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL00049> (referer: https://www.auto1.com/v1/car-details-view/YL00049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ed2fbb97f70849c7e15a0d487104bece.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_d9c22ee407966fff495db809d4024799.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_d9c22ee407966fff495db809d4024799.jpg not downloaded yet
2026-03-27 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_329c149341974c66fdd6348c2ebb2736.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d78150>
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_6525db8171abc22d445b181f44cde4f8.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_6525db8171abc22d445b181f44cde4f8.jpg saved to cache
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9f4d0>
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_0ea2749b911e68c6cb7c5243406261d1.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_0ea2749b911e68c6cb7c5243406261d1.jpg saved to cache
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_6d4371f1a5b9a417b1e8e3f4e0d4c2b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_6d4371f1a5b9a417b1e8e3f4e0d4c2b0.jpg not downloaded yet
2026-03-27 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD96937> (referer: https://www.auto1.com/v1/car-details-view/HD96937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_439205d903a8a57fa8f67e702c9c1b6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_449b1b505b7a94300ece45a043c5ed3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_7235abe5517bdc0318a8af6054917676.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_7235abe5517bdc0318a8af6054917676.jpg not downloaded yet
2026-03-27 20:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-27 20:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc2f0edb-1049-5294-935f-63d616141fcd with scrape type 1
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc2f0edb-1049-5294-935f-63d616141fcd
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_1ae320e59177968a62f5adc5e8ead83f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_1ae320e59177968a62f5adc5e8ead83f.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_6c3a4c922d312cf316416a3d54a632c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_6c3a4c922d312cf316416a3d54a632c1.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_f7c52e1e2cb7f4d8f959520613195aaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_f7c52e1e2cb7f4d8f959520613195aaa.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_b5f12f39520c0c85897c8971635e24d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_b5f12f39520c0c85897c8971635e24d9.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_c828cbf7f17a1ce8347c291f81d0aced.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_c828cbf7f17a1ce8347c291f81d0aced.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_1cdb226bb9c8001e28ca117bb4ff046f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_1cdb226bb9c8001e28ca117bb4ff046f.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_b43b644995a311a013058d8869ca3849.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_b43b644995a311a013058d8869ca3849.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_74ad96373c8041c712cda66520df8f16.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_74ad96373c8041c712cda66520df8f16.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_fb883b14bf7f11c65616f097cfb9f543.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_fb883b14bf7f11c65616f097cfb9f543.jpg already downloaded
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F54%252Faf54ead1c00be7a3a09d32badf27686f%252Fpa%252FYL00049_4fce022449f5f28ae02374902c9f69ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_4fce022449f5f28ae02374902c9f69ae.jpg already downloaded
2026-03-27 20:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc2f0edb-1049-5294-935f-63d616141fcd, identifier: YL00049
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cac1d0>
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_ed2fbb97f70849c7e15a0d487104bece.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ed2fbb97f70849c7e15a0d487104bece.jpg saved to cache
2026-03-27 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903327710>
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_329c149341974c66fdd6348c2ebb2736.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_329c149341974c66fdd6348c2ebb2736.jpg saved to cache
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-27 20:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049
2026-03-27 20:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc2f0edb-1049-5294-935f-63d616141fcd with identifier: YL00049 to the API
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL00049>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:15:10Z',
 'fuel_type': 'diesel',
 'id': 'dc2f0edb-1049-5294-935f-63d616141fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL00049',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 55452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_1ae320e59177968a62f5adc5e8ead83f.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_6c3a4c922d312cf316416a3d54a632c1.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_f7c52e1e2cb7f4d8f959520613195aaa.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_b5f12f39520c0c85897c8971635e24d9.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_c828cbf7f17a1ce8347c291f81d0aced.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_1cdb226bb9c8001e28ca117bb4ff046f.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_b43b644995a311a013058d8869ca3849.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_74ad96373c8041c712cda66520df8f16.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_fb883b14bf7f11c65616f097cfb9f543.jpg',
                'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_4fce022449f5f28ae02374902c9f69ae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_1ae320e59177968a62f5adc5e8ead83f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_6c3a4c922d312cf316416a3d54a632c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_f7c52e1e2cb7f4d8f959520613195aaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_b5f12f39520c0c85897c8971635e24d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_c828cbf7f17a1ce8347c291f81d0aced.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_1cdb226bb9c8001e28ca117bb4ff046f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_b43b644995a311a013058d8869ca3849.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_74ad96373c8041c712cda66520df8f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_fb883b14bf7f11c65616f097cfb9f543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f0edb-1049-5294-935f-63d616141fcd/dc2f0edb-1049-5294-935f-63d616141fcd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/54/af54ead1c00be7a3a09d32badf27686f/pa/YL00049_4fce022449f5f28ae02374902c9f69ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-27 20:38:14 [auto1.be] INFO: Saving data for YL00049: {'created_time': 1774643894.520436, 'last_price_update_time': 1774643894.520447, 'auction_closing_time': 1774714510.0}
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL00049') HTTP/1.1" 204 0
2026-03-27 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_e22ac2eaf9b643bf9dcdeb4e0e7f1b08.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_90a138ae7253e981b9aa9ffec321a9ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0fe35ef8d9b21679a9805b0aebc612a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_880a6eadfd4e1da02c0e028be18c92a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937
2026-03-27 20:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f with scrape type 1
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_c633b74bd64db90c93a7620c0dbbbad4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_c633b74bd64db90c93a7620c0dbbbad4.jpg not downloaded yet
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903203ed0>
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_439205d903a8a57fa8f67e702c9c1b6e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_439205d903a8a57fa8f67e702c9c1b6e.jpg saved to cache
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903335890>
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_449b1b505b7a94300ece45a043c5ed3c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_449b1b505b7a94300ece45a043c5ed3c.jpg saved to cache
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_3b7b270d865d0aa3ff35c1c9b031c7c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_3b7b270d865d0aa3ff35c1c9b031c7c6.jpg not downloaded yet
2026-03-27 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_6d4371f1a5b9a417b1e8e3f4e0d4c2b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_239d3b90cb2fb93c94a4c9ad03789100.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_239d3b90cb2fb93c94a4c9ad03789100.jpg not downloaded yet
2026-03-27 20:38:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d5c0d0>
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_e22ac2eaf9b643bf9dcdeb4e0e7f1b08.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_e22ac2eaf9b643bf9dcdeb4e0e7f1b08.jpg saved to cache
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cd2bd0>
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_90a138ae7253e981b9aa9ffec321a9ee.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_90a138ae7253e981b9aa9ffec321a9ee.jpg saved to cache
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b2310>
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_0fe35ef8d9b21679a9805b0aebc612a6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0fe35ef8d9b21679a9805b0aebc612a6.jpg saved to cache
2026-03-27 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903da5750>
2026-03-27 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_880a6eadfd4e1da02c0e028be18c92a2.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_880a6eadfd4e1da02c0e028be18c92a2.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_1fd8cee75214d8d48a195399bdcb8d73.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_d9c22ee407966fff495db809d4024799.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_ab6b018d8fe379e412581d0941b37782.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_ab6b018d8fe379e412581d0941b37782.jpg not downloaded yet
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_28a65575f12210792eb4438438fd732a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_8d3854c4e63ea538beac59014f00881c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_8d3854c4e63ea538beac59014f00881c.jpg not downloaded yet
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_2fc41bb57bdbd1a6579a4e5ab484cc7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_2fc41bb57bdbd1a6579a4e5ab484cc7c.jpg not downloaded yet
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c6cf10>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_6d4371f1a5b9a417b1e8e3f4e0d4c2b0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_6d4371f1a5b9a417b1e8e3f4e0d4c2b0.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26398752bd92f895211922048790ebef.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_e8a89ea0df800cda7dc0d6abea77273a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_e8a89ea0df800cda7dc0d6abea77273a.jpg not downloaded yet
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0dee9ae772038fc9f5e59f941f2192d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_4dd32809502bf3ec1b17a1ccc16d3fb6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_4dd32809502bf3ec1b17a1ccc16d3fb6.jpg not downloaded yet
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f62310>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_1fd8cee75214d8d48a195399bdcb8d73.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_1fd8cee75214d8d48a195399bdcb8d73.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903254dd0>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_d9c22ee407966fff495db809d4024799.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_d9c22ee407966fff495db809d4024799.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2ca10>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_28a65575f12210792eb4438438fd732a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_28a65575f12210792eb4438438fd732a.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_d94a0d6d4a09655b0b629b86b2329c40.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_d94a0d6d4a09655b0b629b86b2329c40.jpg not downloaded yet
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_7235abe5517bdc0318a8af6054917676.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_37e2510d74a6f8ac30bf3b91e14d499a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_af706c3456e9bdf43a27d9b290078a94.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_af706c3456e9bdf43a27d9b290078a94.jpg not downloaded yet
2026-03-27 20:38:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903efe950>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_26398752bd92f895211922048790ebef.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26398752bd92f895211922048790ebef.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d7b890>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_0dee9ae772038fc9f5e59f941f2192d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0dee9ae772038fc9f5e59f941f2192d8.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b751fba72a5fc7cf49023514e123cd67.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903efb450>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_7235abe5517bdc0318a8af6054917676.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_7235abe5517bdc0318a8af6054917676.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d0bad0>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_37e2510d74a6f8ac30bf3b91e14d499a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_37e2510d74a6f8ac30bf3b91e14d499a.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_239d3b90cb2fb93c94a4c9ad03789100.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_ab6b018d8fe379e412581d0941b37782.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_844815861fd9b65854c59b5e3272099c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2a3fe3808599bee8bcb2045701260bda.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2dc3951f6d5ec000407e92f20cbb9c9e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2643d244029f2e57ccace224e17ee0a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_4929bc205ec6d996592335d0e157a931.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fa6190>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_b751fba72a5fc7cf49023514e123cd67.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b751fba72a5fc7cf49023514e123cd67.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_3b7b270d865d0aa3ff35c1c9b031c7c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033b6510>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_239d3b90cb2fb93c94a4c9ad03789100.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_239d3b90cb2fb93c94a4c9ad03789100.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903263c50>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_ab6b018d8fe379e412581d0941b37782.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_ab6b018d8fe379e412581d0941b37782.jpg saved to cache
2026-03-27 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d39a50>
2026-03-27 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_844815861fd9b65854c59b5e3272099c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_844815861fd9b65854c59b5e3272099c.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903261190>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2a3fe3808599bee8bcb2045701260bda.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2a3fe3808599bee8bcb2045701260bda.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903260710>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2dc3951f6d5ec000407e92f20cbb9c9e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2dc3951f6d5ec000407e92f20cbb9c9e.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e594d0>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2643d244029f2e57ccace224e17ee0a0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2643d244029f2e57ccace224e17ee0a0.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d3a3d0>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_4929bc205ec6d996592335d0e157a931.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_4929bc205ec6d996592335d0e157a931.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_c633b74bd64db90c93a7620c0dbbbad4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_2fc41bb57bdbd1a6579a4e5ab484cc7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_8d3854c4e63ea538beac59014f00881c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b2ad0>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_3b7b270d865d0aa3ff35c1c9b031c7c6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_3b7b270d865d0aa3ff35c1c9b031c7c6.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_d94a0d6d4a09655b0b629b86b2329c40.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_4dd32809502bf3ec1b17a1ccc16d3fb6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031dfdd0>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_c633b74bd64db90c93a7620c0dbbbad4.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_c633b74bd64db90c93a7620c0dbbbad4.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9120fc0d0>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_2fc41bb57bdbd1a6579a4e5ab484cc7c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_2fc41bb57bdbd1a6579a4e5ab484cc7c.jpg saved to cache
2026-03-27 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032571d0>
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_8d3854c4e63ea538beac59014f00881c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_8d3854c4e63ea538beac59014f00881c.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_e8a89ea0df800cda7dc0d6abea77273a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_80948b368bbfa4abf4a67e287b79059a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_341eab0ac728a3af9fed697ab7b0eb2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_e6ff8c788831876da27b4b5a16033a3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e84b50>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_d94a0d6d4a09655b0b629b86b2329c40.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_d94a0d6d4a09655b0b629b86b2329c40.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d43010>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_4dd32809502bf3ec1b17a1ccc16d3fb6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_4dd32809502bf3ec1b17a1ccc16d3fb6.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_af706c3456e9bdf43a27d9b290078a94.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_523b3a97abf3d87928e8efdd5ffd7e82.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e59290>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_e8a89ea0df800cda7dc0d6abea77273a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_e8a89ea0df800cda7dc0d6abea77273a.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90315d110>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_80948b368bbfa4abf4a67e287b79059a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_80948b368bbfa4abf4a67e287b79059a.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032cb750>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_341eab0ac728a3af9fed697ab7b0eb2f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_341eab0ac728a3af9fed697ab7b0eb2f.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90315f910>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_e6ff8c788831876da27b4b5a16033a3b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_e6ff8c788831876da27b4b5a16033a3b.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0071ff573d0bc1cf6fb0d8a444ee6ba5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_b98b629c36f6ec9858d05ddb7b0922a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031a7e90>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a40e2fe02095ccc5a23cee6953dbf%252Fpa%252FHD96937_af706c3456e9bdf43a27d9b290078a94.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_af706c3456e9bdf43a27d9b290078a94.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f
2026-03-27 20:38:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31b9b3c9-d549-53fa-a547-9b191e84cb1f, skipping ID generation
2026-03-27 20:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f with scrape type 1
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31b9b3c9-d549-53fa-a547-9b191e84cb1f sending to next pipeline
2026-03-27 20:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31b9b3c9-d549-53fa-a547-9b191e84cb1f, identifier: HD96937
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031c1510>
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F12%252F44129838e3c170fa03f75b8876a65eb6%252Fpa%252FCC85070_523b3a97abf3d87928e8efdd5ffd7e82.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_523b3a97abf3d87928e8efdd5ffd7e82.jpg saved to cache
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d62c776-1845-5548-aec3-c1ce832c593e
2026-03-27 20:38:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d62c776-1845-5548-aec3-c1ce832c593e, skipping ID generation
2026-03-27 20:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d62c776-1845-5548-aec3-c1ce832c593e with scrape type 1
2026-03-27 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d62c776-1845-5548-aec3-c1ce832c593e sending to next pipeline
2026-03-27 20:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d62c776-1845-5548-aec3-c1ce832c593e, identifier: CC85070
2026-03-27 20:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937
2026-03-27 20:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937
2026-03-27 20:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31b9b3c9-d549-53fa-a547-9b191e84cb1f with identifier: HD96937 to the API
2026-03-27 20:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_af706c3456e9bdf43a27d9b290078a94.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:40:36Z',
 'fuel_type': 'diesel',
 'id': '31b9b3c9-d549-53fa-a547-9b191e84cb1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD96937',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 165977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_c633b74bd64db90c93a7620c0dbbbad4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_3b7b270d865d0aa3ff35c1c9b031c7c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_239d3b90cb2fb93c94a4c9ad03789100.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_ab6b018d8fe379e412581d0941b37782.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_8d3854c4e63ea538beac59014f00881c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_2fc41bb57bdbd1a6579a4e5ab484cc7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_e8a89ea0df800cda7dc0d6abea77273a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_4dd32809502bf3ec1b17a1ccc16d3fb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_d94a0d6d4a09655b0b629b86b2329c40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31b9b3c9-d549-53fa-a547-9b191e84cb1f/31b9b3c9-d549-53fa-a547-9b191e84cb1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396289,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a40e2fe02095ccc5a23cee6953dbf/pa/HD96937_af706c3456e9bdf43a27d9b290078a94.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-27 20:38:18 [auto1.be] INFO: Saving data for HD96937: {'created_time': 1774643898.223455, 'last_price_update_time': 1774643898.223465, 'auction_closing_time': 1774716036.0}
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HD96937') HTTP/1.1" 204 0
2026-03-27 20:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-27 20:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070
2026-03-27 20:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d62c776-1845-5548-aec3-c1ce832c593e with identifier: CC85070 to the API
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_523b3a97abf3d87928e8efdd5ffd7e82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:35:00Z',
 'fuel_type': 'diesel',
 'id': '5d62c776-1845-5548-aec3-c1ce832c593e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC85070',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 146976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_523b3a97abf3d87928e8efdd5ffd7e82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_80948b368bbfa4abf4a67e287b79059a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0fe35ef8d9b21679a9805b0aebc612a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_37e2510d74a6f8ac30bf3b91e14d499a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_0dee9ae772038fc9f5e59f941f2192d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_28a65575f12210792eb4438438fd732a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_1fd8cee75214d8d48a195399bdcb8d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_d9c22ee407966fff495db809d4024799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_6d4371f1a5b9a417b1e8e3f4e0d4c2b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d62c776-1845-5548-aec3-c1ce832c593e/5d62c776-1845-5548-aec3-c1ce832c593e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/12/44129838e3c170fa03f75b8876a65eb6/pa/CC85070_7235abe5517bdc0318a8af6054917676.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.4 CRDi Platinum Edition',
 'transmission': 'manual',
 'trim': 'Platinum Edition',
 'year': 2017}
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-27 20:38:18 [auto1.be] INFO: Saving data for CC85070: {'created_time': 1774643898.572376, 'last_price_update_time': 1774643898.572387, 'auction_closing_time': 1774715700.0}
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC85070') HTTP/1.1" 204 0
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ae25b39b31d500bbdea600bac32ae19f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_2501da482d527529294a11b649fef800.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_318eb9d8323bd609257ea2f1ab948d1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe91f1a7090>
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_0071ff573d0bc1cf6fb0d8a444ee6ba5.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0071ff573d0bc1cf6fb0d8a444ee6ba5.jpg saved to cache
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e4d990>
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_b98b629c36f6ec9858d05ddb7b0922a9.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_b98b629c36f6ec9858d05ddb7b0922a9.jpg saved to cache
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e5a790>
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_ae25b39b31d500bbdea600bac32ae19f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ae25b39b31d500bbdea600bac32ae19f.jpg saved to cache
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e85b90>
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_2501da482d527529294a11b649fef800.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_2501da482d527529294a11b649fef800.jpg saved to cache
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9124a8cd0>
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_318eb9d8323bd609257ea2f1ab948d1c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_318eb9d8323bd609257ea2f1ab948d1c.jpg saved to cache
2026-03-27 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_5b0c7e0d62eee4a6c63a1ccb12982087.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_cbddff9d3bedb4f765fb9d2ac9c7e116.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_407f029cee025eefeb6c7265013a9be1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_815d367a4b5bc638a7386f6a6734f94e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26d27b588c2d74a4cb944b27080cb64e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_0347d38870cd2f7d9fade9b29a3d0fea.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_33adabb2d282df40babbaefc86915561.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6ab57d8aea8055cba9d11abf61df9404.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_832044a273838fc07c7cae36ae62bf32.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_9ceca6285e627f6539972226673bc616.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90315f550>
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_5b0c7e0d62eee4a6c63a1ccb12982087.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_5b0c7e0d62eee4a6c63a1ccb12982087.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_c60e3a3f26d92363d0e2befe4831fcab.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ecd710>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_cbddff9d3bedb4f765fb9d2ac9c7e116.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_cbddff9d3bedb4f765fb9d2ac9c7e116.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032fa410>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_407f029cee025eefeb6c7265013a9be1.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_407f029cee025eefeb6c7265013a9be1.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6c510>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_815d367a4b5bc638a7386f6a6734f94e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_815d367a4b5bc638a7386f6a6734f94e.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e87050>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_26d27b588c2d74a4cb944b27080cb64e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26d27b588c2d74a4cb944b27080cb64e.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032fa010>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_0347d38870cd2f7d9fade9b29a3d0fea.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_0347d38870cd2f7d9fade9b29a3d0fea.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903321850>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_33adabb2d282df40babbaefc86915561.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_33adabb2d282df40babbaefc86915561.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903393590>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_6ab57d8aea8055cba9d11abf61df9404.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6ab57d8aea8055cba9d11abf61df9404.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ba0f062e0bb308453779ef8f1686fcde.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_96f659b95bf5c6e702aa7cf490ea7630.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR17508> (referer: https://www.auto1.com/v1/car-details-view/JR17508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2f050>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_832044a273838fc07c7cae36ae62bf32.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_832044a273838fc07c7cae36ae62bf32.jpg saved to cache
2026-03-27 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c5cc90>
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_9ceca6285e627f6539972226673bc616.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_9ceca6285e627f6539972226673bc616.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f7b50>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_c60e3a3f26d92363d0e2befe4831fcab.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_c60e3a3f26d92363d0e2befe4831fcab.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033e30d0>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_ba0f062e0bb308453779ef8f1686fcde.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ba0f062e0bb308453779ef8f1686fcde.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c68f50>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_96f659b95bf5c6e702aa7cf490ea7630.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_96f659b95bf5c6e702aa7cf490ea7630.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01dec726-936e-5020-8683-c0df7241d4ef with identifier: JR17508
2026-03-27 20:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01dec726-936e-5020-8683-c0df7241d4ef with scrape type 1
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_e2ad5eda54c4f44d138109b5aa25dfb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_e2ad5eda54c4f44d138109b5aa25dfb1.jpg not downloaded yet
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_f3b53c688b4fc8a3d5722ad5928a3d32.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f3b53c688b4fc8a3d5722ad5928a3d32.jpg not downloaded yet
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_95b36de3c664faa41709330225c29701.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6d36c4b0ea08e213b43de4b93be30648.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0123765466b9b8038c034eef88be29b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_0b22996966621cc697332b389410dd4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_991c2b69834fb325611849201ed55d08.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_991c2b69834fb325611849201ed55d08.jpg not downloaded yet
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_1acad3f080ce12d998631ea59d519afe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_49e0159ac4fb4fec970569feb5d4f864.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_49e0159ac4fb4fec970569feb5d4f864.jpg not downloaded yet
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_df17ec718d6842893961f9892a78b994.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_df17ec718d6842893961f9892a78b994.jpg not downloaded yet
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_fcadece2bc147f93044e7e90bc9b37cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_fcadece2bc147f93044e7e90bc9b37cf.jpg not downloaded yet
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_ade7cdfdbc8d0401242199a15b74c9a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_dcea4870a3f1ee43c2b901ece017f469.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_dcea4870a3f1ee43c2b901ece017f469.jpg not downloaded yet
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_f34e8147aaf5cec344366e3a37138ff0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_37d53ef5d3a6faf50b0743d23266b39c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_37d53ef5d3a6faf50b0743d23266b39c.jpg not downloaded yet
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_5ffb17cd569561b099a68584c4838436.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e71b90>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_95b36de3c664faa41709330225c29701.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_95b36de3c664faa41709330225c29701.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cacc50>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_6d36c4b0ea08e213b43de4b93be30648.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6d36c4b0ea08e213b43de4b93be30648.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e28d0>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_0123765466b9b8038c034eef88be29b6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0123765466b9b8038c034eef88be29b6.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cd1350>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_0b22996966621cc697332b389410dd4c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_0b22996966621cc697332b389410dd4c.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_6a4f5a9c256462dcbceffbe35cee9e35.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_6a4f5a9c256462dcbceffbe35cee9e35.jpg not downloaded yet
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_3963afe0417e92b62c23b0686f29b6e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e4f10>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_1acad3f080ce12d998631ea59d519afe.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_1acad3f080ce12d998631ea59d519afe.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7929b878efb794e0ea4376dd80a645dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_f0ab58f371e24cb5ef167cd2095edc15.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_f17d5d16dfa96d6c48f8926486001dc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f17d5d16dfa96d6c48f8926486001dc6.jpg not downloaded yet
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_4a600db436e7c53c5d2206f4800fe6f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_42c70afce90241ff927dda68a69599fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903da4090>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_ade7cdfdbc8d0401242199a15b74c9a2.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_ade7cdfdbc8d0401242199a15b74c9a2.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c69bd0>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_f34e8147aaf5cec344366e3a37138ff0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_f34e8147aaf5cec344366e3a37138ff0.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cd2a50>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_5ffb17cd569561b099a68584c4838436.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_5ffb17cd569561b099a68584c4838436.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903da09d0>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_3963afe0417e92b62c23b0686f29b6e6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_3963afe0417e92b62c23b0686f29b6e6.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_e2ad5eda54c4f44d138109b5aa25dfb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2e5d416c6b600cef3969a830ab6fdea8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_02f803ef9eeb3cb67bef49ffe6d9cae3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_cf70ab49893c240d09ec22b2c93c9c3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d92990>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_7929b878efb794e0ea4376dd80a645dd.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7929b878efb794e0ea4376dd80a645dd.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eb1250>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_f0ab58f371e24cb5ef167cd2095edc15.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_f0ab58f371e24cb5ef167cd2095edc15.jpg saved to cache
2026-03-27 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2de50>
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_4a600db436e7c53c5d2206f4800fe6f3.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_4a600db436e7c53c5d2206f4800fe6f3.jpg saved to cache
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903efc0d0>
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_42c70afce90241ff927dda68a69599fd.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_42c70afce90241ff927dda68a69599fd.jpg saved to cache
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b88722b00d76c77a7faf913b7030ac96.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2d410>
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_e2ad5eda54c4f44d138109b5aa25dfb1.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_e2ad5eda54c4f44d138109b5aa25dfb1.jpg saved to cache
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e58350>
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Feb%252F5febb70fdb2a8a25aff1678fad39d0e7%252Fpa%252FVB55746_2e5d416c6b600cef3969a830ab6fdea8.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2e5d416c6b600cef3969a830ab6fdea8.jpg saved to cache
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18
2026-03-27 20:38:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18, skipping ID generation
2026-03-27 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with scrape type 1
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 sending to next pipeline
2026-03-27 20:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18, identifier: VB55746
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323d110>
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_02f803ef9eeb3cb67bef49ffe6d9cae3.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_02f803ef9eeb3cb67bef49ffe6d9cae3.jpg saved to cache
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90330f790>
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F17%252F5b1767bcc959bba263d4b49a9bd0ba53%252Fpa%252FCK64923_cf70ab49893c240d09ec22b2c93c9c3b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_cf70ab49893c240d09ec22b2c93c9c3b.jpg saved to cache
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01bbcac9-be80-5f93-8a33-7618fc30eab6
2026-03-27 20:38:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01bbcac9-be80-5f93-8a33-7618fc30eab6, skipping ID generation
2026-03-27 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bbcac9-be80-5f93-8a33-7618fc30eab6 with scrape type 1
2026-03-27 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01bbcac9-be80-5f93-8a33-7618fc30eab6 sending to next pipeline
2026-03-27 20:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01bbcac9-be80-5f93-8a33-7618fc30eab6, identifier: CK64923
2026-03-27 20:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_fcadece2bc147f93044e7e90bc9b37cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-27 20:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746
2026-03-27 20:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7f52fa47-a3e2-5ce3-ac47-f9f69db83e18 with identifier: VB55746 to the API
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2e5d416c6b600cef3969a830ab6fdea8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:12:54Z',
 'fuel_type': 'petrol',
 'id': '7f52fa47-a3e2-5ce3-ac47-f9f69db83e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB55746',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 123897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572447,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2e5d416c6b600cef3969a830ab6fdea8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2618303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_33adabb2d282df40babbaefc86915561.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_0347d38870cd2f7d9fade9b29a3d0fea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_815d367a4b5bc638a7386f6a6734f94e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2a3fe3808599bee8bcb2045701260bda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_cbddff9d3bedb4f765fb9d2ac9c7e116.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_407f029cee025eefeb6c7265013a9be1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_4929bc205ec6d996592335d0e157a931.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2dc3951f6d5ec000407e92f20cbb9c9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f52fa47-a3e2-5ce3-ac47-f9f69db83e18/7f52fa47-a3e2-5ce3-ac47-f9f69db83e18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/eb/5febb70fdb2a8a25aff1678fad39d0e7/pa/VB55746_2643d244029f2e57ccace224e17ee0a0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-27 20:38:22 [auto1.be] INFO: Saving data for VB55746: {'created_time': 1774643902.035282, 'last_price_update_time': 1774643902.035294, 'auction_closing_time': 1774714374.0}
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB55746') HTTP/1.1" 204 0
2026-03-27 20:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923
2026-03-27 20:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923
2026-03-27 20:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923 to the API
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_cf70ab49893c240d09ec22b2c93c9c3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:06:28Z',
 'fuel_type': 'diesel',
 'id': '01bbcac9-be80-5f93-8a33-7618fc30eab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK64923',
 'listing': 'auction',
 'location': 'BE',
 'make': 'BMW',
 'model': '3er',
 'odometer': 165919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d62528e86e2d95699ea3d72ac221654c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_39ee54486110fbb8adbc321c615c6075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_cf70ab49893c240d09ec22b2c93c9c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_d15e440d9957f41323a39e8fecba0095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_ade7cdfdbc8d0401242199a15b74c9a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134427,
             'Height': 560,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_0b22996966621cc697332b389410dd4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_449b1b505b7a94300ece45a043c5ed3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_439205d903a8a57fa8f67e702c9c1b6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_90a138ae7253e981b9aa9ffec321a9ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01bbcac9-be80-5f93-8a33-7618fc30eab6/01bbcac9-be80-5f93-8a33-7618fc30eab6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/17/5b1767bcc959bba263d4b49a9bd0ba53/pa/CK64923_b98b629c36f6ec9858d05ddb7b0922a9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-27 20:38:22 [auto1.be] INFO: Saving data for CK64923: {'created_time': 1774643902.349671, 'last_price_update_time': 1774643902.34968, 'auction_closing_time': 1774713988.0}
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK64923') HTTP/1.1" 204 0
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f3b53c688b4fc8a3d5722ad5928a3d32.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d7a090>
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_b88722b00d76c77a7faf913b7030ac96.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b88722b00d76c77a7faf913b7030ac96.jpg saved to cache
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323fc10>
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_fcadece2bc147f93044e7e90bc9b37cf.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_fcadece2bc147f93044e7e90bc9b37cf.jpg saved to cache
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_df17ec718d6842893961f9892a78b994.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_37d53ef5d3a6faf50b0743d23266b39c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_dcea4870a3f1ee43c2b901ece017f469.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_6a4f5a9c256462dcbceffbe35cee9e35.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f17d5d16dfa96d6c48f8926486001dc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903faf090>
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_f3b53c688b4fc8a3d5722ad5928a3d32.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f3b53c688b4fc8a3d5722ad5928a3d32.jpg saved to cache
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_200421a23cc1d82b5d23c5fe07ad7932.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_49e0159ac4fb4fec970569feb5d4f864.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903311810>
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_df17ec718d6842893961f9892a78b994.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_df17ec718d6842893961f9892a78b994.jpg saved to cache
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033b56d0>
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_37d53ef5d3a6faf50b0743d23266b39c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_37d53ef5d3a6faf50b0743d23266b39c.jpg saved to cache
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc1d50>
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_dcea4870a3f1ee43c2b901ece017f469.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_dcea4870a3f1ee43c2b901ece017f469.jpg saved to cache
2026-03-27 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032ead10>
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_6a4f5a9c256462dcbceffbe35cee9e35.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_6a4f5a9c256462dcbceffbe35cee9e35.jpg saved to cache
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903da3f50>
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_f17d5d16dfa96d6c48f8926486001dc6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f17d5d16dfa96d6c48f8926486001dc6.jpg saved to cache
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_991c2b69834fb325611849201ed55d08.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_1712a0fa17e4ffbd8c6f4fecbfdff4b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_d5b14bea56f6fe18eeda20bb2e0039fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_ad87dfda33cd16d4ac1c06c620afcb3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7129fcbb038ca304971458ab7450419b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903321b10>
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F07%252Fb9079b5f452d813e10ed93d49800ca32%252Fpa%252FMS34473_200421a23cc1d82b5d23c5fe07ad7932.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_200421a23cc1d82b5d23c5fe07ad7932.jpg saved to cache
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc
2026-03-27 20:38:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc, skipping ID generation
2026-03-27 20:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc with scrape type 1
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc sending to next pipeline
2026-03-27 20:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc, identifier: MS34473
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9121294d0>
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_49e0159ac4fb4fec970569feb5d4f864.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_49e0159ac4fb4fec970569feb5d4f864.jpg saved to cache
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc with identifier: MS34473
2026-03-27 20:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc with identifier: MS34473
2026-03-27 20:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ae7f761-bf4f-5ac4-9463-218a65eb3bfc with identifier: MS34473 to the API
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_200421a23cc1d82b5d23c5fe07ad7932.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:22:36Z',
 'fuel_type': 'petrol',
 'id': '0ae7f761-bf4f-5ac4-9463-218a65eb3bfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS34473',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 183944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_200421a23cc1d82b5d23c5fe07ad7932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_4a600db436e7c53c5d2206f4800fe6f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108894,
             'Height': 591,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_f0ab58f371e24cb5ef167cd2095edc15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ed2fbb97f70849c7e15a0d487104bece.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_96f659b95bf5c6e702aa7cf490ea7630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ba0f062e0bb308453779ef8f1686fcde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_c60e3a3f26d92363d0e2befe4831fcab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_318eb9d8323bd609257ea2f1ab948d1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_ae25b39b31d500bbdea600bac32ae19f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ae7f761-bf4f-5ac4-9463-218a65eb3bfc/0ae7f761-bf4f-5ac4-9463-218a65eb3bfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/07/b9079b5f452d813e10ed93d49800ca32/pa/MS34473_e6ff8c788831876da27b4b5a16033a3b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI GT Line",
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2016}
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS34473%27 HTTP/1.1" 200 None
2026-03-27 20:38:23 [auto1.be] INFO: Saving data for MS34473: {'created_time': 1774643903.63274, 'last_price_update_time': 1774643903.63275, 'auction_closing_time': 1774714956.0}
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS34473') HTTP/1.1" 204 0
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_cab0ade73fe9a9585c39d0578c39f97c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_674d4798cb31b3b5be2f960ced176813.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_b1230cb164308a7a835d881d8f7ba833.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE52220> (referer: https://www.auto1.com/v1/car-details-view/FE52220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033f6450>
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fc1%252F67c1a244b620f2350a4869e843ff318f%252Fpa%252FJR17508_991c2b69834fb325611849201ed55d08.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_991c2b69834fb325611849201ed55d08.jpg saved to cache
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01dec726-936e-5020-8683-c0df7241d4ef
2026-03-27 20:38:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01dec726-936e-5020-8683-c0df7241d4ef, skipping ID generation
2026-03-27 20:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01dec726-936e-5020-8683-c0df7241d4ef with scrape type 1
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01dec726-936e-5020-8683-c0df7241d4ef sending to next pipeline
2026-03-27 20:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01dec726-936e-5020-8683-c0df7241d4ef, identifier: JR17508
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90330c750>
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F63%252Fe7632206907ec90c3acc85e880c70a7d%252Fpa%252FRK88808_1712a0fa17e4ffbd8c6f4fecbfdff4b3.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_1712a0fa17e4ffbd8c6f4fecbfdff4b3.jpg saved to cache
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70
2026-03-27 20:38:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70, skipping ID generation
2026-03-27 20:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with scrape type 1
2026-03-27 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 sending to next pipeline
2026-03-27 20:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70, identifier: RK88808
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f84f90>
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_d5b14bea56f6fe18eeda20bb2e0039fa.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_d5b14bea56f6fe18eeda20bb2e0039fa.jpg saved to cache
2026-03-27 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e55c50>
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_ad87dfda33cd16d4ac1c06c620afcb3b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_ad87dfda33cd16d4ac1c06c620afcb3b.jpg saved to cache
2026-03-27 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cac750>
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fc4%252F26c4ef0b0d922347823542f7e068cff5%252Fpa%252FXC82229_7129fcbb038ca304971458ab7450419b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7129fcbb038ca304971458ab7450419b.jpg saved to cache
2026-03-27 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 702e2a30-4411-5c01-9d91-776d01caa249
2026-03-27 20:38:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 702e2a30-4411-5c01-9d91-776d01caa249, skipping ID generation
2026-03-27 20:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702e2a30-4411-5c01-9d91-776d01caa249 with scrape type 1
2026-03-27 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 702e2a30-4411-5c01-9d91-776d01caa249 sending to next pipeline
2026-03-27 20:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 702e2a30-4411-5c01-9d91-776d01caa249, identifier: XC82229
2026-03-27 20:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01dec726-936e-5020-8683-c0df7241d4ef with identifier: JR17508
2026-03-27 20:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01dec726-936e-5020-8683-c0df7241d4ef with identifier: JR17508
2026-03-27 20:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01dec726-936e-5020-8683-c0df7241d4ef with identifier: JR17508 to the API
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_991c2b69834fb325611849201ed55d08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:05:20Z',
 'fuel_type': 'hybrid',
 'id': '01dec726-936e-5020-8683-c0df7241d4ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR17508',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 79984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40371,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_e2ad5eda54c4f44d138109b5aa25dfb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340927,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f3b53c688b4fc8a3d5722ad5928a3d32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337806,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_991c2b69834fb325611849201ed55d08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351476,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_49e0159ac4fb4fec970569feb5d4f864.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316027,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_df17ec718d6842893961f9892a78b994.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317191,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_fcadece2bc147f93044e7e90bc9b37cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340262,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_dcea4870a3f1ee43c2b901ece017f469.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321019,
             'Height': 1358,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_37d53ef5d3a6faf50b0743d23266b39c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316103,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_6a4f5a9c256462dcbceffbe35cee9e35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dec726-936e-5020-8683-c0df7241d4ef/01dec726-936e-5020-8683-c0df7241d4ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43890,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img67/c1/67c1a244b620f2350a4869e843ff318f/pa/JR17508_f17d5d16dfa96d6c48f8926486001dc6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR17508%27 HTTP/1.1" 200 None
2026-03-27 20:38:24 [auto1.be] INFO: Saving data for JR17508: {'created_time': 1774643904.628142, 'last_price_update_time': 1774643904.628153, 'auction_closing_time': 1774713920.0}
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JR17508') HTTP/1.1" 204 0
2026-03-27 20:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808
2026-03-27 20:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808
2026-03-27 20:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77a25f8c-4baa-5ce3-afb0-63316d0f5c70 with identifier: RK88808 to the API
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_1712a0fa17e4ffbd8c6f4fecbfdff4b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:19:36Z',
 'fuel_type': 'petrol',
 'id': '77a25f8c-4baa-5ce3-afb0-63316d0f5c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK88808',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 118799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_1712a0fa17e4ffbd8c6f4fecbfdff4b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_42c70afce90241ff927dda68a69599fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_f34e8147aaf5cec344366e3a37138ff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_95b36de3c664faa41709330225c29701.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0123765466b9b8038c034eef88be29b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_9ceca6285e627f6539972226673bc616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_5b0c7e0d62eee4a6c63a1ccb12982087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_2501da482d527529294a11b649fef800.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_0071ff573d0bc1cf6fb0d8a444ee6ba5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77a25f8c-4baa-5ce3-afb0-63316d0f5c70/77a25f8c-4baa-5ce3-afb0-63316d0f5c70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/63/e7632206907ec90c3acc85e880c70a7d/pa/RK88808_341eab0ac728a3af9fed697ab7b0eb2f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2019}
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-27 20:38:24 [auto1.be] INFO: Saving data for RK88808: {'created_time': 1774643904.956833, 'last_price_update_time': 1774643904.956844, 'auction_closing_time': 1774714776.0}
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK88808') HTTP/1.1" 204 0
2026-03-27 20:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-27 20:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229
2026-03-27 20:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 702e2a30-4411-5c01-9d91-776d01caa249 with identifier: XC82229 to the API
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7129fcbb038ca304971458ab7450419b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:20Z',
 'fuel_type': 'diesel',
 'id': '702e2a30-4411-5c01-9d91-776d01caa249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC82229',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 107341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7129fcbb038ca304971458ab7450419b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_ad87dfda33cd16d4ac1c06c620afcb3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_4f670bba5b8cc6f56aabf242fc032355.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_d5b14bea56f6fe18eeda20bb2e0039fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_02f803ef9eeb3cb67bef49ffe6d9cae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_7929b878efb794e0ea4376dd80a645dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_3963afe0417e92b62c23b0686f29b6e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6d36c4b0ea08e213b43de4b93be30648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_832044a273838fc07c7cae36ae62bf32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_702e2a30-4411-5c01-9d91-776d01caa249/702e2a30-4411-5c01-9d91-776d01caa249_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/c4/26c4ef0b0d922347823542f7e068cff5/pa/XC82229_6ab57d8aea8055cba9d11abf61df9404.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [auto1.be] INFO: Saving data for XC82229: {'created_time': 1774643905.272469, 'last_price_update_time': 1774643905.272479, 'auction_closing_time': 1774716260.0}
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC82229') HTTP/1.1" 204 0
2026-03-27 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_dcbec3b961e24d42b6776dfe686c94a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_453e8847b29c4e9b34f3cae08b281d6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911e47910>
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_cab0ade73fe9a9585c39d0578c39f97c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_cab0ade73fe9a9585c39d0578c39f97c.jpg saved to cache
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce7190>
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_674d4798cb31b3b5be2f960ced176813.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_674d4798cb31b3b5be2f960ced176813.jpg saved to cache
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903266210>
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_b1230cb164308a7a835d881d8f7ba833.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_b1230cb164308a7a835d881d8f7ba833.jpg saved to cache
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-27 20:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dea1b79-b33b-5ea2-9059-2d7927825751 with scrape type 1
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_d1c80325073ede47da3a38f4145f1e74.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_d1c80325073ede47da3a38f4145f1e74.jpg not downloaded yet
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_f8c49c1ba1056b339198a77ddd961033.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f8c49c1ba1056b339198a77ddd961033.jpg not downloaded yet
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_c6b595f47671111772cc599dea1b630c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_c6b595f47671111772cc599dea1b630c.jpg not downloaded yet
2026-03-27 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_ed2f93278ab116e52f4ec5a510ee7542.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b7910>
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_dcbec3b961e24d42b6776dfe686c94a7.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_dcbec3b961e24d42b6776dfe686c94a7.jpg saved to cache
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90328a490>
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_453e8847b29c4e9b34f3cae08b281d6e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_453e8847b29c4e9b34f3cae08b281d6e.jpg saved to cache
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_3c305141c8528e81803d563e88bfebc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3c305141c8528e81803d563e88bfebc6.jpg not downloaded yet
2026-03-27 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_0d512f50c10c8490bce695217ebaf421.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_fcbb40247e016e24bfc9e3c630f8e2e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_fcbb40247e016e24bfc9e3c630f8e2e9.jpg not downloaded yet
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_774e145b21614339d78f835f8852cc42.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_774e145b21614339d78f835f8852cc42.jpg not downloaded yet
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903205110>
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_ed2f93278ab116e52f4ec5a510ee7542.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_ed2f93278ab116e52f4ec5a510ee7542.jpg saved to cache
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_2e6e6aea08a8744cce15315cd468b00b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_f874486e4d9872ca3649981003c0b159.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f874486e4d9872ca3649981003c0b159.jpg not downloaded yet
2026-03-27 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_937018b1fd9f4066490eed4adcd7aa85.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_5d0917442cad2525e9572888695bea7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_5d0917442cad2525e9572888695bea7d.jpg not downloaded yet
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_3e4a15630a4255f14dbff718279d763d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3e4a15630a4255f14dbff718279d763d.jpg not downloaded yet
2026-03-27 20:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9fd10>
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbb%252F5bbbef0b904ff2bfd1c8f822f12e8614%252Fpa%252FFS38787_0d512f50c10c8490bce695217ebaf421.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_0d512f50c10c8490bce695217ebaf421.jpg saved to cache
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b492033-8422-51be-bbf0-0322a3f6da80
2026-03-27 20:38:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b492033-8422-51be-bbf0-0322a3f6da80, skipping ID generation
2026-03-27 20:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b492033-8422-51be-bbf0-0322a3f6da80 with scrape type 1
2026-03-27 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b492033-8422-51be-bbf0-0322a3f6da80 sending to next pipeline
2026-03-27 20:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b492033-8422-51be-bbf0-0322a3f6da80, identifier: FS38787
2026-03-27 20:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-27 20:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787
2026-03-27 20:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b492033-8422-51be-bbf0-0322a3f6da80 with identifier: FS38787 to the API
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_0d512f50c10c8490bce695217ebaf421.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:24:06Z',
 'fuel_type': 'diesel',
 'id': '5b492033-8422-51be-bbf0-0322a3f6da80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS38787',
 'listing': 'auction',
 'location': 'BE, Wommelgem',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 220154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2338346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26398752bd92f895211922048790ebef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2303464,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_880a6eadfd4e1da02c0e028be18c92a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_0d512f50c10c8490bce695217ebaf421.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2473417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b751fba72a5fc7cf49023514e123cd67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2322363,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_674d4798cb31b3b5be2f960ced176813.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1814299,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_b88722b00d76c77a7faf913b7030ac96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1877740,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_1acad3f080ce12d998631ea59d519afe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2022015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_5ffb17cd569561b099a68584c4838436.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2196591,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_844815861fd9b65854c59b5e3272099c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b492033-8422-51be-bbf0-0322a3f6da80/5b492033-8422-51be-bbf0-0322a3f6da80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2706913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bb/5bbbef0b904ff2bfd1c8f822f12e8614/pa/FS38787_26d27b588c2d74a4cb944b27080cb64e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2011}
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-27 20:38:26 [auto1.be] INFO: Saving data for FS38787: {'created_time': 1774643906.427234, 'last_price_update_time': 1774643906.427247, 'auction_closing_time': 1774715046.0}
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FS38787') HTTP/1.1" 204 0
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_bfb88068640bcd67cea5693e5d44d861.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_bfb88068640bcd67cea5693e5d44d861.jpg not downloaded yet
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_4ba1216a39c3dae1573ad05312df4f76.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce6c10>
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_2e6e6aea08a8744cce15315cd468b00b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_2e6e6aea08a8744cce15315cd468b00b.jpg saved to cache
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ed850>
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_937018b1fd9f4066490eed4adcd7aa85.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_937018b1fd9f4066490eed4adcd7aa85.jpg saved to cache
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_896542e98a570c17a1f9ac340c3156ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_24508f70e33b05b9393e1fc3821b9c64.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a9f897dfcb48d12bb31f53b18e9f460a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a0cab73be5f9d4c2fe8652569e132bc0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_2239c65bc2eff7547d7d4e03e8f5e75c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_19afa0a7e5482ef997362e2f2075fc53.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f35d0>
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_4ba1216a39c3dae1573ad05312df4f76.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_4ba1216a39c3dae1573ad05312df4f76.jpg saved to cache
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78477a3c-a638-585c-8cb2-230e49297ede
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_fde78ba7253e3716efe6e33d16a19d62.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_8a92026ac72dc8459744deee46a429da.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_774e145b21614339d78f835f8852cc42.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d456ed9de3d379b883bcd3da4d87b52d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_c6b595f47671111772cc599dea1b630c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_cb129a9fa89b98f35f80f2c362811aa4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f8c49c1ba1056b339198a77ddd961033.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903288310>
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_896542e98a570c17a1f9ac340c3156ec.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_896542e98a570c17a1f9ac340c3156ec.jpg saved to cache
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_fcbb40247e016e24bfc9e3c630f8e2e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_bfb88068640bcd67cea5693e5d44d861.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3e4a15630a4255f14dbff718279d763d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d03050>
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_24508f70e33b05b9393e1fc3821b9c64.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_24508f70e33b05b9393e1fc3821b9c64.jpg saved to cache
2026-03-27 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f8d890>
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_a9f897dfcb48d12bb31f53b18e9f460a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a9f897dfcb48d12bb31f53b18e9f460a.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c7d650>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_a0cab73be5f9d4c2fe8652569e132bc0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a0cab73be5f9d4c2fe8652569e132bc0.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90311cb90>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_2239c65bc2eff7547d7d4e03e8f5e75c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_2239c65bc2eff7547d7d4e03e8f5e75c.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033ddad0>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_19afa0a7e5482ef997362e2f2075fc53.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_19afa0a7e5482ef997362e2f2075fc53.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033d6d10>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_fde78ba7253e3716efe6e33d16a19d62.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_fde78ba7253e3716efe6e33d16a19d62.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6c510>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe1%252Fece1b3045b5ead24cb44774e7e6502b7%252Fpa%252FRM32931_8a92026ac72dc8459744deee46a429da.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_8a92026ac72dc8459744deee46a429da.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f
2026-03-27 20:38:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f, skipping ID generation
2026-03-27 20:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with scrape type 1
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c39c42e-0bc5-53aa-bda9-b92d0c77374f sending to next pipeline
2026-03-27 20:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f, identifier: RM32931
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ef1d0>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_774e145b21614339d78f835f8852cc42.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_774e145b21614339d78f835f8852cc42.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fa5f10>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_d456ed9de3d379b883bcd3da4d87b52d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d456ed9de3d379b883bcd3da4d87b52d.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6c9d0>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_c6b595f47671111772cc599dea1b630c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_c6b595f47671111772cc599dea1b630c.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ee1bd0>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_cb129a9fa89b98f35f80f2c362811aa4.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_cb129a9fa89b98f35f80f2c362811aa4.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78477a3c-a638-585c-8cb2-230e49297ede
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cadcd0>
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_f8c49c1ba1056b339198a77ddd961033.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f8c49c1ba1056b339198a77ddd961033.jpg saved to cache
2026-03-27 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-27 20:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931
2026-03-27 20:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c39c42e-0bc5-53aa-bda9-b92d0c77374f with identifier: RM32931 to the API
2026-03-27 20:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_8a92026ac72dc8459744deee46a429da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:27:49Z',
 'fuel_type': 'diesel',
 'id': '3c39c42e-0bc5-53aa-bda9-b92d0c77374f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM32931',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Nissan',
 'model': 'Navara Pick-up',
 'odometer': 89671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2634717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_ac397578061ab4d2a1cb22042a298486.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2563854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_8a92026ac72dc8459744deee46a429da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_19afa0a7e5482ef997362e2f2075fc53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447129,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_2239c65bc2eff7547d7d4e03e8f5e75c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2418930,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_0ea2749b911e68c6cb7c5243406261d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549954,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_329c149341974c66fdd6348c2ebb2736.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_24508f70e33b05b9393e1fc3821b9c64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_e22ac2eaf9b643bf9dcdeb4e0e7f1b08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2529408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a9f897dfcb48d12bb31f53b18e9f460a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c39c42e-0bc5-53aa-bda9-b92d0c77374f/3c39c42e-0bc5-53aa-bda9-b92d0c77374f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2733948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e1/ece1b3045b5ead24cb44774e7e6502b7/pa/RM32931_a0cab73be5f9d4c2fe8652569e132bc0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Navara Pick-up 3.0 V6 dCi Double Cab LE 4x4',
 'transmission': 'automatic',
 'trim': 'Double Cab LE 4x4',
 'year': 2016}
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-27 20:38:28 [auto1.be] INFO: Saving data for RM32931: {'created_time': 1774643908.183247, 'last_price_update_time': 1774643908.183257, 'auction_closing_time': 1774715269.0}
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM32931') HTTP/1.1" 204 0
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90322a890>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_fcbb40247e016e24bfc9e3c630f8e2e9.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_fcbb40247e016e24bfc9e3c630f8e2e9.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033e3d90>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_bfb88068640bcd67cea5693e5d44d861.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_bfb88068640bcd67cea5693e5d44d861.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903faf990>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_3e4a15630a4255f14dbff718279d763d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3e4a15630a4255f14dbff718279d763d.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_3903c2ea5cdedc55a4fd9d89eeec2390.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_d1c80325073ede47da3a38f4145f1e74.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f874486e4d9872ca3649981003c0b159.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ce3fab53a5226a04042f5d4ae11daee.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_926345b687682108575bc3da5e674a03.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3c305141c8528e81803d563e88bfebc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_5d0917442cad2525e9572888695bea7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_e1cb4f63ba83258f7c134cee22afcc28.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_cc8c4cd6cca1069aee097cebde3f718f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_958a1831e11eadf6a1284987cc70c502.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_911192b43ee5b2c126d05aea470a72e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903228550>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_3903c2ea5cdedc55a4fd9d89eeec2390.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_3903c2ea5cdedc55a4fd9d89eeec2390.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_034f552bb3c60f359fe1885967340273.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_fa64a0a35a2b66f208aceceb5df12e24.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e3e50>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_d1c80325073ede47da3a38f4145f1e74.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_d1c80325073ede47da3a38f4145f1e74.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dbb150>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_f874486e4d9872ca3649981003c0b159.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f874486e4d9872ca3649981003c0b159.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903264450>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_5ce3fab53a5226a04042f5d4ae11daee.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ce3fab53a5226a04042f5d4ae11daee.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903efb450>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_926345b687682108575bc3da5e674a03.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_926345b687682108575bc3da5e674a03.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78477a3c-a638-585c-8cb2-230e49297ede
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903336910>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_3c305141c8528e81803d563e88bfebc6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3c305141c8528e81803d563e88bfebc6.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d0b990>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb6%252Fb2b67b4902e20252255d000b423f9902%252Fpa%252FFE52220_5d0917442cad2525e9572888695bea7d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_5d0917442cad2525e9572888695bea7d.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1dea1b79-b33b-5ea2-9059-2d7927825751
2026-03-27 20:38:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dea1b79-b33b-5ea2-9059-2d7927825751, skipping ID generation
2026-03-27 20:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dea1b79-b33b-5ea2-9059-2d7927825751 with scrape type 1
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dea1b79-b33b-5ea2-9059-2d7927825751 sending to next pipeline
2026-03-27 20:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1dea1b79-b33b-5ea2-9059-2d7927825751, identifier: FE52220
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fad990>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_e1cb4f63ba83258f7c134cee22afcc28.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_e1cb4f63ba83258f7c134cee22afcc28.jpg saved to cache
2026-03-27 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78477a3c-a638-585c-8cb2-230e49297ede
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9c450>
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_cc8c4cd6cca1069aee097cebde3f718f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_cc8c4cd6cca1069aee097cebde3f718f.jpg saved to cache
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ef5a90>
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Fc2%252Ff5c20ca4f9b392b568307869453b193d%252Fpa%252FHH43502_958a1831e11eadf6a1284987cc70c502.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_958a1831e11eadf6a1284987cc70c502.jpg saved to cache
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11841c30-afee-5ca2-9fe8-83ac77b862ea
2026-03-27 20:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11841c30-afee-5ca2-9fe8-83ac77b862ea, skipping ID generation
2026-03-27 20:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11841c30-afee-5ca2-9fe8-83ac77b862ea with scrape type 1
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11841c30-afee-5ca2-9fe8-83ac77b862ea sending to next pipeline
2026-03-27 20:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11841c30-afee-5ca2-9fe8-83ac77b862ea, identifier: HH43502
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dbae50>
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F7a%252F467ad280cb4e51d996cdc613738fb6fe%252Fpa%252FDM52841_911192b43ee5b2c126d05aea470a72e3.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_911192b43ee5b2c126d05aea470a72e3.jpg saved to cache
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78477a3c-a638-585c-8cb2-230e49297ede
2026-03-27 20:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78477a3c-a638-585c-8cb2-230e49297ede, skipping ID generation
2026-03-27 20:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78477a3c-a638-585c-8cb2-230e49297ede with scrape type 1
2026-03-27 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78477a3c-a638-585c-8cb2-230e49297ede sending to next pipeline
2026-03-27 20:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78477a3c-a638-585c-8cb2-230e49297ede, identifier: DM52841
2026-03-27 20:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-27 20:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220
2026-03-27 20:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1dea1b79-b33b-5ea2-9059-2d7927825751 with identifier: FE52220 to the API
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_5d0917442cad2525e9572888695bea7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:44:49Z',
 'fuel_type': 'petrol',
 'id': '1dea1b79-b33b-5ea2-9059-2d7927825751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE52220',
 'listing': 'auction',
 'location': 'BE, Waver',
 'make': 'BMW',
 'model': '3er',
 'odometer': 140989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_d1c80325073ede47da3a38f4145f1e74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f8c49c1ba1056b339198a77ddd961033.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_c6b595f47671111772cc599dea1b630c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3c305141c8528e81803d563e88bfebc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_fcbb40247e016e24bfc9e3c630f8e2e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_774e145b21614339d78f835f8852cc42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_f874486e4d9872ca3649981003c0b159.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_5d0917442cad2525e9572888695bea7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_3e4a15630a4255f14dbff718279d763d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dea1b79-b33b-5ea2-9059-2d7927825751/1dea1b79-b33b-5ea2-9059-2d7927825751_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b6/b2b67b4902e20252255d000b423f9902/pa/FE52220_bfb88068640bcd67cea5693e5d44d861.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-27 20:38:29 [auto1.be] INFO: Saving data for FE52220: {'created_time': 1774643909.545391, 'last_price_update_time': 1774643909.545401, 'auction_closing_time': 1774716289.0}
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE52220') HTTP/1.1" 204 0
2026-03-27 20:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11841c30-afee-5ca2-9fe8-83ac77b862ea with identifier: HH43502
2026-03-27 20:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11841c30-afee-5ca2-9fe8-83ac77b862ea with identifier: HH43502
2026-03-27 20:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11841c30-afee-5ca2-9fe8-83ac77b862ea with identifier: HH43502 to the API
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_958a1831e11eadf6a1284987cc70c502.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:09:33Z',
 'fuel_type': 'diesel',
 'id': '11841c30-afee-5ca2-9fe8-83ac77b862ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH43502',
 'listing': 'auction',
 'location': 'BE, Lommel',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 356923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_958a1831e11eadf6a1284987cc70c502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ee372135684214f42e65f0cba13f7ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_5ce3fab53a5226a04042f5d4ae11daee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_4bfa2e0e579ed5806bccef19b3d600a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_fde78ba7253e3716efe6e33d16a19d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_937018b1fd9f4066490eed4adcd7aa85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_453e8847b29c4e9b34f3cae08b281d6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_b1230cb164308a7a835d881d8f7ba833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_cab0ade73fe9a9585c39d0578c39f97c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11841c30-afee-5ca2-9fe8-83ac77b862ea/11841c30-afee-5ca2-9fe8-83ac77b862ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/c2/f5c20ca4f9b392b568307869453b193d/pa/HH43502_9bea6193020cc4ab41274ed756878d36.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang 4Motion',
 'transmission': 'manual',
 'trim': 'Kasten lang 4Motion',
 'year': 2011}
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH43502%27 HTTP/1.1" 200 None
2026-03-27 20:38:29 [auto1.be] INFO: Saving data for HH43502: {'created_time': 1774643909.893929, 'last_price_update_time': 1774643909.893945, 'auction_closing_time': 1774714173.0}
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH43502') HTTP/1.1" 204 0
2026-03-27 20:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-27 20:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841
2026-03-27 20:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78477a3c-a638-585c-8cb2-230e49297ede with identifier: DM52841 to the API
2026-03-27 20:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_911192b43ee5b2c126d05aea470a72e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:21:53Z',
 'fuel_type': 'petrol',
 'id': '78477a3c-a638-585c-8cb2-230e49297ede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM52841',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 104842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_911192b43ee5b2c126d05aea470a72e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_047192eabf316d709ba588da1995a744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_e1cb4f63ba83258f7c134cee22afcc28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_926345b687682108575bc3da5e674a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_cb129a9fa89b98f35f80f2c362811aa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78477a3c-a638-585c-8cb2-230e49297ede/78477a3c-a638-585c-8cb2-230e49297ede_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/7a/467ad280cb4e51d996cdc613738fb6fe/pa/DM52841_4ba1216a39c3dae1573ad05312df4f76.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-27 20:38:30 [auto1.be] INFO: Saving data for DM52841: {'created_time': 1774643910.219452, 'last_price_update_time': 1774643910.219462, 'auction_closing_time': 1774714913.0}
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM52841') HTTP/1.1" 204 0
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_342cfa9428eb7321fe79a061361556fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903392990>
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_034f552bb3c60f359fe1885967340273.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_034f552bb3c60f359fe1885967340273.jpg saved to cache
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d7a910>
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_fa64a0a35a2b66f208aceceb5df12e24.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_fa64a0a35a2b66f208aceceb5df12e24.jpg saved to cache
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f46d0>
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_342cfa9428eb7321fe79a061361556fe.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_342cfa9428eb7321fe79a061361556fe.jpg saved to cache
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_f40c1847362f1f36452e9dc78ad3a832.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_283de8355876a1ecdfaed62c8cd19ebc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_698e009846fe3bbc5f75b089c7d408fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_e22b120cb84b4d591f2d4f683cb28985.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_a12019f04dd043d1449248ce3c1cb97e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8afbabced8ad2837964502d1704b0ae7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fb95633d4ccf3c245fb40e22d89d2f19.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_67acc03506cd3cf3d832d22b95703c55.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a682afaa42f5c1bd21a511948cb54b05.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_63bb819bb2b937e1f5d618514c14b9f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032cdd90>
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Ffc%252Ffafc8dd882ea7c1bb6e9587b031508ef%252Fpa%252FRU10603_f40c1847362f1f36452e9dc78ad3a832.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_f40c1847362f1f36452e9dc78ad3a832.jpg saved to cache
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8508898-f2f2-5c2f-af7f-49a19194831b
2026-03-27 20:38:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8508898-f2f2-5c2f-af7f-49a19194831b, skipping ID generation
2026-03-27 20:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8508898-f2f2-5c2f-af7f-49a19194831b with scrape type 1
2026-03-27 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8508898-f2f2-5c2f-af7f-49a19194831b sending to next pipeline
2026-03-27 20:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8508898-f2f2-5c2f-af7f-49a19194831b, identifier: RU10603
2026-03-27 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_8a8227734ee4b57817798219297b260b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-27 20:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603
2026-03-27 20:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8508898-f2f2-5c2f-af7f-49a19194831b with identifier: RU10603 to the API
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_f40c1847362f1f36452e9dc78ad3a832.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:33Z',
 'fuel_type': 'diesel',
 'id': 'e8508898-f2f2-5c2f-af7f-49a19194831b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU10603',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 111369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_cc8c4cd6cca1069aee097cebde3f718f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d8602eacf104a405a0c8adab15558f48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420858,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_f40c1847362f1f36452e9dc78ad3a832.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_d456ed9de3d379b883bcd3da4d87b52d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2027833,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_3903c2ea5cdedc55a4fd9d89eeec2390.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_2e6e6aea08a8744cce15315cd468b00b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_ed2f93278ab116e52f4ec5a510ee7542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_dcbec3b961e24d42b6776dfe686c94a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2222733,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_896542e98a570c17a1f9ac340c3156ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8508898-f2f2-5c2f-af7f-49a19194831b/e8508898-f2f2-5c2f-af7f-49a19194831b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2176003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/fc/fafc8dd882ea7c1bb6e9587b031508ef/pa/RU10603_6525db8171abc22d445b181f44cde4f8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2017}
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-27 20:38:31 [auto1.be] INFO: Saving data for RU10603: {'created_time': 1774643911.13316, 'last_price_update_time': 1774643911.133171, 'auction_closing_time': 1774715313.0}
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU10603') HTTP/1.1" 204 0
2026-03-27 20:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ef7cd0>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_283de8355876a1ecdfaed62c8cd19ebc.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_283de8355876a1ecdfaed62c8cd19ebc.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90315c350>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_698e009846fe3bbc5f75b089c7d408fb.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_698e009846fe3bbc5f75b089c7d408fb.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90315ef50>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_e22b120cb84b4d591f2d4f683cb28985.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_e22b120cb84b4d591f2d4f683cb28985.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ca41d0>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_a12019f04dd043d1449248ce3c1cb97e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_a12019f04dd043d1449248ce3c1cb97e.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc7110>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_8afbabced8ad2837964502d1704b0ae7.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8afbabced8ad2837964502d1704b0ae7.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ceb0d0>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_fb95633d4ccf3c245fb40e22d89d2f19.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fb95633d4ccf3c245fb40e22d89d2f19.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c87c90>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_67acc03506cd3cf3d832d22b95703c55.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_67acc03506cd3cf3d832d22b95703c55.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f7b10>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_a682afaa42f5c1bd21a511948cb54b05.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a682afaa42f5c1bd21a511948cb54b05.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9dd50>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_63bb819bb2b937e1f5d618514c14b9f6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_63bb819bb2b937e1f5d618514c14b9f6.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ca5150>
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_8a8227734ee4b57817798219297b260b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_8a8227734ee4b57817798219297b260b.jpg saved to cache
2026-03-27 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_b16efb239b4bae48be80f891a2dddf46.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_d43f35693131ba7e27c4ff3c0b739adb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_4bff16c86dfff2c2eb7c1fbb9c616986.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_e5089b58cca32340eb4b980235fc726f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_bd36e29d0ce292e413deea6b064c962b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_7f8f06d9d7ffc1fb26b793899adecf97.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_c4e61eb86e95a935b269c6a466be368f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a949234e6353cbf8922dfb00235b1d96.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903da5e90>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_b16efb239b4bae48be80f891a2dddf46.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_b16efb239b4bae48be80f891a2dddf46.jpg saved to cache
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_202d840f0dda5c7df46f69e9ce9e534c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903317e10>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_d43f35693131ba7e27c4ff3c0b739adb.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_d43f35693131ba7e27c4ff3c0b739adb.jpg saved to cache
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ee490>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_4bff16c86dfff2c2eb7c1fbb9c616986.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_4bff16c86dfff2c2eb7c1fbb9c616986.jpg saved to cache
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e4dd50>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_e5089b58cca32340eb4b980235fc726f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_e5089b58cca32340eb4b980235fc726f.jpg saved to cache
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d48150>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_bd36e29d0ce292e413deea6b064c962b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_bd36e29d0ce292e413deea6b064c962b.jpg saved to cache
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e4c450>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_7f8f06d9d7ffc1fb26b793899adecf97.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_7f8f06d9d7ffc1fb26b793899adecf97.jpg saved to cache
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903330190>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_c4e61eb86e95a935b269c6a466be368f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_c4e61eb86e95a935b269c6a466be368f.jpg saved to cache
2026-03-27 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b7710>
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_a949234e6353cbf8922dfb00235b1d96.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a949234e6353cbf8922dfb00235b1d96.jpg saved to cache
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903efec90>
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_202d840f0dda5c7df46f69e9ce9e534c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_202d840f0dda5c7df46f69e9ce9e534c.jpg saved to cache
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_141e62feceafd8b7525a37866be5c8d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033a4a50>
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_141e62feceafd8b7525a37866be5c8d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_141e62feceafd8b7525a37866be5c8d8.jpg saved to cache
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fcf1cfcb6c1905114b25e4d2a1383f41.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7dc6cfb285c4c4f9989a7463e024af72.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_b674baa16c839ced556f3abd2d02d495.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_932ef65b871392eac41ac8295a16e063.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_41e6c4128b3584a75d3c361c26b755a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_af5e0df0e5ad39a28bdd3169f3cb9b2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_02fb239cc80201eaad58742065c63b0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8f3de5ba5221950da1a406046bb10dad.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_41286feced46a0a6e17ac4bbb340173b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033218d0>
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_fcf1cfcb6c1905114b25e4d2a1383f41.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fcf1cfcb6c1905114b25e4d2a1383f41.jpg saved to cache
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e702d0>
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_7dc6cfb285c4c4f9989a7463e024af72.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7dc6cfb285c4c4f9989a7463e024af72.jpg saved to cache
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2d950>
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_b674baa16c839ced556f3abd2d02d495.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_b674baa16c839ced556f3abd2d02d495.jpg saved to cache
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903267890>
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_932ef65b871392eac41ac8295a16e063.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_932ef65b871392eac41ac8295a16e063.jpg saved to cache
2026-03-27 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ed8750>
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_41e6c4128b3584a75d3c361c26b755a4.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_41e6c4128b3584a75d3c361c26b755a4.jpg saved to cache
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903267450>
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_af5e0df0e5ad39a28bdd3169f3cb9b2e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_af5e0df0e5ad39a28bdd3169f3cb9b2e.jpg saved to cache
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e80150>
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F5f%252F285f55bd2280607acdb107d411dfb44f%252Fpa%252FPS72966_02fb239cc80201eaad58742065c63b0e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_02fb239cc80201eaad58742065c63b0e.jpg saved to cache
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfac3745-102b-5e51-88ec-ce03459d40c5
2026-03-27 20:38:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfac3745-102b-5e51-88ec-ce03459d40c5, skipping ID generation
2026-03-27 20:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfac3745-102b-5e51-88ec-ce03459d40c5 with scrape type 1
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfac3745-102b-5e51-88ec-ce03459d40c5 sending to next pipeline
2026-03-27 20:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfac3745-102b-5e51-88ec-ce03459d40c5, identifier: PS72966
2026-03-27 20:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b0790>
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F50%252F4050932e99df38c17c564ec8dab5243e%252Fpa%252FNP17382_8f3de5ba5221950da1a406046bb10dad.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8f3de5ba5221950da1a406046bb10dad.jpg saved to cache
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6
2026-03-27 20:38:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6, skipping ID generation
2026-03-27 20:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with scrape type 1
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 sending to next pipeline
2026-03-27 20:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6, identifier: NP17382
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ed8550>
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fbe%252F15bec1643b4bc6fafe99ac243481ae56%252Fpa%252FJB70681_41286feced46a0a6e17ac4bbb340173b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_41286feced46a0a6e17ac4bbb340173b.jpg saved to cache
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8
2026-03-27 20:38:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8, skipping ID generation
2026-03-27 20:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with scrape type 1
2026-03-27 20:38:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 sending to next pipeline
2026-03-27 20:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8, identifier: JB70681
2026-03-27 20:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-27 20:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966
2026-03-27 20:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfac3745-102b-5e51-88ec-ce03459d40c5 with identifier: PS72966 to the API
2026-03-27 20:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_02fb239cc80201eaad58742065c63b0e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:22:20Z',
 'fuel_type': 'diesel',
 'id': 'cfac3745-102b-5e51-88ec-ce03459d40c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS72966',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 43817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fcf1cfcb6c1905114b25e4d2a1383f41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902147,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_02fb239cc80201eaad58742065c63b0e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_af5e0df0e5ad39a28bdd3169f3cb9b2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2761682,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_c4e61eb86e95a935b269c6a466be368f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_63bb819bb2b937e1f5d618514c14b9f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2879507,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_e5089b58cca32340eb4b980235fc726f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_034f552bb3c60f359fe1885967340273.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_fb95633d4ccf3c245fb40e22d89d2f19.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_9fc168286e4932708e64a20e1e609109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfac3745-102b-5e51-88ec-ce03459d40c5/cfac3745-102b-5e51-88ec-ce03459d40c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2601378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/5f/285f55bd2280607acdb107d411dfb44f/pa/PS72966_550f035295e9be826aee9dd312539d09.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-27 20:38:35 [auto1.be] INFO: Saving data for PS72966: {'created_time': 1774643915.226094, 'last_price_update_time': 1774643915.226106, 'auction_closing_time': 1774714940.0}
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS72966') HTTP/1.1" 204 0
2026-03-27 20:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-27 20:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382
2026-03-27 20:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c202a75-ed5a-5c64-a1ad-7def648fb7e6 with identifier: NP17382 to the API
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8f3de5ba5221950da1a406046bb10dad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:40:54Z',
 'fuel_type': 'petrol',
 'id': '2c202a75-ed5a-5c64-a1ad-7def648fb7e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP17382',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 17561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518561,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8f3de5ba5221950da1a406046bb10dad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_41e6c4128b3584a75d3c361c26b755a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628521,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_932ef65b871392eac41ac8295a16e063.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450444,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_bd36e29d0ce292e413deea6b064c962b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_7f8f06d9d7ffc1fb26b793899adecf97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_b16efb239b4bae48be80f891a2dddf46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_a12019f04dd043d1449248ce3c1cb97e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_8afbabced8ad2837964502d1704b0ae7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_37e002e017173e1f16c9b8c10e1b3e44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c202a75-ed5a-5c64-a1ad-7def648fb7e6/2c202a75-ed5a-5c64-a1ad-7def648fb7e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2930287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/50/4050932e99df38c17c564ec8dab5243e/pa/NP17382_47898c58b2b8a55515d44960fae9e9e8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-27 20:38:35 [auto1.be] INFO: Saving data for NP17382: {'created_time': 1774643915.565849, 'last_price_update_time': 1774643915.565859, 'auction_closing_time': 1774716054.0}
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP17382') HTTP/1.1" 204 0
2026-03-27 20:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-27 20:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681
2026-03-27 20:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8 with identifier: JB70681 to the API
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_41286feced46a0a6e17ac4bbb340173b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'petrol',
 'id': 'ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB70681',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '6er',
 'odometer': 121416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_41286feced46a0a6e17ac4bbb340173b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_202d840f0dda5c7df46f69e9ce9e534c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a949234e6353cbf8922dfb00235b1d96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_8a8227734ee4b57817798219297b260b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_a682afaa42f5c1bd21a511948cb54b05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_67acc03506cd3cf3d832d22b95703c55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_342cfa9428eb7321fe79a061361556fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_fa64a0a35a2b66f208aceceb5df12e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_71614a7ef9465cab65c9e98c9843799c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8/ff5fe9df-db9e-54f3-9caa-9bb67bdac5e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/be/15bec1643b4bc6fafe99ac243481ae56/pa/JB70681_2e7e61b77670855b9bf7492453aa84a0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 6er 630i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-27 20:38:35 [auto1.be] INFO: Saving data for JB70681: {'created_time': 1774643915.864878, 'last_price_update_time': 1774643915.864887, 'auction_closing_time': 1774716882.0}
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB70681') HTTP/1.1" 204 0
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE21828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ82537> (referer: https://www.auto1.com/v1/car-details-view/PJ82537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX40265> (referer: https://www.auto1.com/v1/car-details-view/TX40265/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP74524> (referer: https://www.auto1.com/v1/car-details-view/YP74524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7c70089d6f50ab9513df37f1d8203717.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_534e5f33f08f90e37e49e4afb5b36735.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_911fa602b3d52292f4e82693c0f551b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_64524c71c31f4d215c5d552eee82a558.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_4f9460e0e9805839b3e024964c4cde39.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_009ab14a5457ae4d5415c81c327a712c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_96192cdcd811161b8f9e304a95fad967.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-27 20:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45fcdd64-6b7c-50e9-934f-6137291a16a3 with scrape type 1
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45fcdd64-6b7c-50e9-934f-6137291a16a3
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_2ff010dc237a74b6f04b743569f03152.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_2ff010dc237a74b6f04b743569f03152.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_ee0173a7471863fd1426117af7709e97.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_ee0173a7471863fd1426117af7709e97.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_13f58bf51d1f9811cb555627db586595.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_13f58bf51d1f9811cb555627db586595.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_313e622c882c42ef199c13b6cf6826ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_313e622c882c42ef199c13b6cf6826ca.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_3c9ef36ef8df77ef1fad5a81d9d4ed20.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_3c9ef36ef8df77ef1fad5a81d9d4ed20.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_a0eff8ac0a25971f639ec6c7e5c05219.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_a0eff8ac0a25971f639ec6c7e5c05219.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_69b4bddbd9e89ee0fa83b80846d4e324.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_69b4bddbd9e89ee0fa83b80846d4e324.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_dfe414d8dbb7be1a5adbe8cb08a7aabf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_dfe414d8dbb7be1a5adbe8cb08a7aabf.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_4d230ed32e3ffcd53fd8e266980eb65e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_4d230ed32e3ffcd53fd8e266980eb65e.jpg already downloaded
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fb9%252Fb0b9f5011167f183745dd2d56ee0eb36%252Fpa%252FPJ82537_f6050919fe2f78388ccc12a0e5136b6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_f6050919fe2f78388ccc12a0e5136b6a.jpg already downloaded
2026-03-27 20:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45fcdd64-6b7c-50e9-934f-6137291a16a3, identifier: PJ82537
2026-03-27 20:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-27 20:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb74d561-fe35-51dc-afbc-3d7048a98f74 with scrape type 1
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_932ef450542c50ff7fe3e7db482e3fcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_932ef450542c50ff7fe3e7db482e3fcf.jpg not downloaded yet
2026-03-27 20:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-27 20:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with scrape type 1
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_57ceeaf8f62e3b18300f70ecc45685b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_57ceeaf8f62e3b18300f70ecc45685b9.jpg not downloaded yet
2026-03-27 20:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-27 20:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537
2026-03-27 20:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45fcdd64-6b7c-50e9-934f-6137291a16a3 with identifier: PJ82537 to the API
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PJ82537>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:50:28Z',
 'fuel_type': 'petrol',
 'id': '45fcdd64-6b7c-50e9-934f-6137291a16a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ82537',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 23545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_2ff010dc237a74b6f04b743569f03152.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_ee0173a7471863fd1426117af7709e97.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_13f58bf51d1f9811cb555627db586595.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_313e622c882c42ef199c13b6cf6826ca.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_3c9ef36ef8df77ef1fad5a81d9d4ed20.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_a0eff8ac0a25971f639ec6c7e5c05219.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_69b4bddbd9e89ee0fa83b80846d4e324.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_dfe414d8dbb7be1a5adbe8cb08a7aabf.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_4d230ed32e3ffcd53fd8e266980eb65e.jpg',
                'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_f6050919fe2f78388ccc12a0e5136b6a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_2ff010dc237a74b6f04b743569f03152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_ee0173a7471863fd1426117af7709e97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_13f58bf51d1f9811cb555627db586595.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_313e622c882c42ef199c13b6cf6826ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_3c9ef36ef8df77ef1fad5a81d9d4ed20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_a0eff8ac0a25971f639ec6c7e5c05219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_69b4bddbd9e89ee0fa83b80846d4e324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_dfe414d8dbb7be1a5adbe8cb08a7aabf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_4d230ed32e3ffcd53fd8e266980eb65e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45fcdd64-6b7c-50e9-934f-6137291a16a3/45fcdd64-6b7c-50e9-934f-6137291a16a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/b9/b0b9f5011167f183745dd2d56ee0eb36/pa/PJ82537_f6050919fe2f78388ccc12a0e5136b6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [auto1.be] INFO: Saving data for PJ82537: {'created_time': 1774643916.637018, 'last_price_update_time': 1774643916.637034, 'auction_closing_time': 1774716628.0}
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ82537') HTTP/1.1" 204 0
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_cf5b176dbb0b832136ab4c8252bf0f89.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_cf5b176dbb0b832136ab4c8252bf0f89.jpg not downloaded yet
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_040c077ab5eecc993baa0aac51b89481.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_040c077ab5eecc993baa0aac51b89481.jpg not downloaded yet
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_0c4832c3a2ef6b8220d9e0b8b65ff512.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0c4832c3a2ef6b8220d9e0b8b65ff512.jpg not downloaded yet
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_179e2279ca704f82d4200b717f215889.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_179e2279ca704f82d4200b717f215889.jpg not downloaded yet
2026-03-27 20:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ47044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e831d0>
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_7c70089d6f50ab9513df37f1d8203717.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7c70089d6f50ab9513df37f1d8203717.jpg saved to cache
2026-03-27 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe91fab8e50>
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Ff8%252F30f8f426035643b0f3b6ce4fd2526a5f%252Fpa%252FLR03762_534e5f33f08f90e37e49e4afb5b36735.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_534e5f33f08f90e37e49e4afb5b36735.jpg saved to cache
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08
2026-03-27 20:38:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1eeceb52-402f-5d63-9f0c-86a76fd0ac08, skipping ID generation
2026-03-27 20:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08 with scrape type 1
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1eeceb52-402f-5d63-9f0c-86a76fd0ac08 sending to next pipeline
2026-03-27 20:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1eeceb52-402f-5d63-9f0c-86a76fd0ac08, identifier: LR03762
2026-03-27 20:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f8ecd0>
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_911fa602b3d52292f4e82693c0f551b0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_911fa602b3d52292f4e82693c0f551b0.jpg saved to cache
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ef7ed0>
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fa3%252F3ea377f031a60780fc3d9289dde9f8b4%252Fpa%252FET18736_64524c71c31f4d215c5d552eee82a558.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_64524c71c31f4d215c5d552eee82a558.jpg saved to cache
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3247b2e-7a95-55d9-9f26-c42622767438
2026-03-27 20:38:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3247b2e-7a95-55d9-9f26-c42622767438, skipping ID generation
2026-03-27 20:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3247b2e-7a95-55d9-9f26-c42622767438 with scrape type 1
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3247b2e-7a95-55d9-9f26-c42622767438 sending to next pipeline
2026-03-27 20:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3247b2e-7a95-55d9-9f26-c42622767438, identifier: ET18736
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe910d12550>
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_4f9460e0e9805839b3e024964c4cde39.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_4f9460e0e9805839b3e024964c4cde39.jpg saved to cache
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90312ca90>
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_009ab14a5457ae4d5415c81c327a712c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_009ab14a5457ae4d5415c81c327a712c.jpg saved to cache
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90312e3d0>
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_96192cdcd811161b8f9e304a95fad967.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_96192cdcd811161b8f9e304a95fad967.jpg saved to cache
2026-03-27 20:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1eeceb52-402f-5d63-9f0c-86a76fd0ac08 with identifier: LR03762
2026-03-27 20:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1eeceb52-402f-5d63-9f0c-86a76fd0ac08 with identifier: LR03762
2026-03-27 20:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1eeceb52-402f-5d63-9f0c-86a76fd0ac08 with identifier: LR03762 to the API
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_534e5f33f08f90e37e49e4afb5b36735.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:24:11Z',
 'fuel_type': 'petrol',
 'id': '1eeceb52-402f-5d63-9f0c-86a76fd0ac08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR03762',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 61443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2155349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7c70089d6f50ab9513df37f1d8203717.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2330376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_534e5f33f08f90e37e49e4afb5b36735.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201583,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_b674baa16c839ced556f3abd2d02d495.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2264084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_7dc6cfb285c4c4f9989a7463e024af72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2213990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_141e62feceafd8b7525a37866be5c8d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2087636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_4bff16c86dfff2c2eb7c1fbb9c616986.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2027923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_d43f35693131ba7e27c4ff3c0b739adb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2121318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_e22b120cb84b4d591f2d4f683cb28985.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2143876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_283de8355876a1ecdfaed62c8cd19ebc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eeceb52-402f-5d63-9f0c-86a76fd0ac08/1eeceb52-402f-5d63-9f0c-86a76fd0ac08_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/f8/30f8f426035643b0f3b6ce4fd2526a5f/pa/LR03762_698e009846fe3bbc5f75b089c7d408fb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR03762%27 HTTP/1.1" 200 None
2026-03-27 20:38:37 [auto1.be] INFO: Saving data for LR03762: {'created_time': 1774643917.953877, 'last_price_update_time': 1774643917.953887, 'auction_closing_time': 1774715051.0}
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LR03762') HTTP/1.1" 204 0
2026-03-27 20:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-27 20:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736
2026-03-27 20:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3247b2e-7a95-55d9-9f26-c42622767438 with identifier: ET18736 to the API
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_64524c71c31f4d215c5d552eee82a558.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:17Z',
 'fuel_type': 'diesel',
 'id': 'a3247b2e-7a95-55d9-9f26-c42622767438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET18736',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 153841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504985,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_f2d4a2f794968f8ac27e2f21128ff8db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_911fa602b3d52292f4e82693c0f551b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_64524c71c31f4d215c5d552eee82a558.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2428681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_ee884d18256651b8d394328645be1567.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1f620d5b5d7c9b9cdae8b67d5df19d1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2431548,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_682848de2d961fa10637f22788bba396.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_6307f43b103815bb418d6491e3b49fb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_1ae260813ca9d821fbb16f73f375fe82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_d10854ed5d6d34f80c9b217362272430.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3247b2e-7a95-55d9-9f26-c42622767438/a3247b2e-7a95-55d9-9f26-c42622767438_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690134,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/a3/3ea377f031a60780fc3d9289dde9f8b4/pa/ET18736_315fb2ce33f412f4ac0546cfb5933c19.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Business Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Edition Start/Stop',
 'year': 2017}
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [auto1.be] INFO: Saving data for ET18736: {'created_time': 1774643918.277404, 'last_price_update_time': 1774643918.277415, 'auction_closing_time': 1774715057.0}
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET18736') HTTP/1.1" 204 0
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_ca4f54825636fbad65f0fce2947dfafd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_ca4f54825636fbad65f0fce2947dfafd.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_e740cb658637e6892d7d04aefaa2aa9f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e740cb658637e6892d7d04aefaa2aa9f.jpg not downloaded yet
2026-03-27 20:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_0107b1b4a0716c77f58f5ba6157bbbaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0107b1b4a0716c77f58f5ba6157bbbaa.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_d8bb1c635b08554e36145574cf4a0d2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_d8bb1c635b08554e36145574cf4a0d2f.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_17b0bed2693b2d15b7bc67be35b0d664.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_17b0bed2693b2d15b7bc67be35b0d664.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_3cb8b8c844b03a41376633526b84de8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_3cb8b8c844b03a41376633526b84de8f.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_324933697f237f52a0c6ef628c9d8473.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_324933697f237f52a0c6ef628c9d8473.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_e686ef6c0c365c54f3bcb5ea49cbc6e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e686ef6c0c365c54f3bcb5ea49cbc6e3.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_f1b9d71cfb35c83359fdbaf1c8f72034.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_f1b9d71cfb35c83359fdbaf1c8f72034.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_ddd28a4f48b0ea84ede58b5892736659.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_ddd28a4f48b0ea84ede58b5892736659.jpg not downloaded yet
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0c4832c3a2ef6b8220d9e0b8b65ff512.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_cf5b176dbb0b832136ab4c8252bf0f89.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_5c5f60856e3667c3317c94154c45be2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_5c5f60856e3667c3317c94154c45be2d.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_11b35c6d52e1fb5c436afb885e15ffc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_11b35c6d52e1fb5c436afb885e15ffc9.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_be626ae0b3e39417451e8f7e05702881.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_be626ae0b3e39417451e8f7e05702881.jpg not downloaded yet
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_5bb41b66a59ef8b004486db2239efe20.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_5bb41b66a59ef8b004486db2239efe20.jpg not downloaded yet
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_040c077ab5eecc993baa0aac51b89481.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_57ceeaf8f62e3b18300f70ecc45685b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ef6ed0>
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_0c4832c3a2ef6b8220d9e0b8b65ff512.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0c4832c3a2ef6b8220d9e0b8b65ff512.jpg saved to cache
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e6850>
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_cf5b176dbb0b832136ab4c8252bf0f89.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_cf5b176dbb0b832136ab4c8252bf0f89.jpg saved to cache
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_179e2279ca704f82d4200b717f215889.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_f1b9d71cfb35c83359fdbaf1c8f72034.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9fc10>
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_040c077ab5eecc993baa0aac51b89481.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_040c077ab5eecc993baa0aac51b89481.jpg saved to cache
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903332ad0>
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_57ceeaf8f62e3b18300f70ecc45685b9.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_57ceeaf8f62e3b18300f70ecc45685b9.jpg saved to cache
2026-03-27 20:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_9bf01e58acb7917f2e9e384074c96e0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_1615655fabfc9427d3d7fe7ced310651.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_ddd28a4f48b0ea84ede58b5892736659.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS70966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b49d0>
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_179e2279ca704f82d4200b717f215889.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_179e2279ca704f82d4200b717f215889.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f97750>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_f1b9d71cfb35c83359fdbaf1c8f72034.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_f1b9d71cfb35c83359fdbaf1c8f72034.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_11b35c6d52e1fb5c436afb885e15ffc9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_5bb41b66a59ef8b004486db2239efe20.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_0d8888441ae0a8077046d5614d738520.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_be626ae0b3e39417451e8f7e05702881.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_5c5f60856e3667c3317c94154c45be2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR50529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f9810>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_9bf01e58acb7917f2e9e384074c96e0f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_9bf01e58acb7917f2e9e384074c96e0f.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:38:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b3610>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_1615655fabfc9427d3d7fe7ced310651.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_1615655fabfc9427d3d7fe7ced310651.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dad110>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_ddd28a4f48b0ea84ede58b5892736659.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_ddd28a4f48b0ea84ede58b5892736659.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_16044b01fc204635625a6d7824190514.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL87249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE21828> (referer: https://www.auto1.com/v1/car-details-view/CE21828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e686ef6c0c365c54f3bcb5ea49cbc6e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903311790>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_11b35c6d52e1fb5c436afb885e15ffc9.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_11b35c6d52e1fb5c436afb885e15ffc9.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323f050>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_5bb41b66a59ef8b004486db2239efe20.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_5bb41b66a59ef8b004486db2239efe20.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031d6fd0>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_0d8888441ae0a8077046d5614d738520.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_0d8888441ae0a8077046d5614d738520.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c92790>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_be626ae0b3e39417451e8f7e05702881.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_be626ae0b3e39417451e8f7e05702881.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e8350>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_5c5f60856e3667c3317c94154c45be2d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_5c5f60856e3667c3317c94154c45be2d.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323cf90>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_16044b01fc204635625a6d7824190514.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_16044b01fc204635625a6d7824190514.jpg saved to cache
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a979e851-3c77-51f1-b728-a0cacafea257 with identifier: CE21828
2026-03-27 20:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a979e851-3c77-51f1-b728-a0cacafea257 with scrape type 1
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_7ca73275c30e0c3d8ad16e578854c290.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7ca73275c30e0c3d8ad16e578854c290.jpg not downloaded yet
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90317cd10>
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_e686ef6c0c365c54f3bcb5ea49cbc6e3.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e686ef6c0c365c54f3bcb5ea49cbc6e3.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_324933697f237f52a0c6ef628c9d8473.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_ca4f54825636fbad65f0fce2947dfafd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_fc7064dd144ac00ae17d3ad853035662.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_fc7064dd144ac00ae17d3ad853035662.jpg not downloaded yet
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0107b1b4a0716c77f58f5ba6157bbbaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_17b0bed2693b2d15b7bc67be35b0d664.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_32ca8034ccd4ac129cccbd99c71cfd17.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_32ca8034ccd4ac129cccbd99c71cfd17.jpg not downloaded yet
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_4fac707ef398e75361f1dc4683f0f3b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_4fac707ef398e75361f1dc4683f0f3b5.jpg not downloaded yet
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_3cb8b8c844b03a41376633526b84de8f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_d8bb1c635b08554e36145574cf4a0d2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e740cb658637e6892d7d04aefaa2aa9f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_589444aea0bf289eb3421bf0a754e4db.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_589444aea0bf289eb3421bf0a754e4db.jpg not downloaded yet
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_1fdf19a2cd34b93eff61b33e88bd0669.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_1fdf19a2cd34b93eff61b33e88bd0669.jpg not downloaded yet
2026-03-27 20:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7ca73275c30e0c3d8ad16e578854c290.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_0bd501fef31a3a34bd0445474256c942.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_0bd501fef31a3a34bd0445474256c942.jpg not downloaded yet
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b2250>
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_324933697f237f52a0c6ef628c9d8473.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_324933697f237f52a0c6ef628c9d8473.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90339fc10>
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_ca4f54825636fbad65f0fce2947dfafd.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_ca4f54825636fbad65f0fce2947dfafd.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_7a5c9a497aa4e110c0f76610950a6cfd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7a5c9a497aa4e110c0f76610950a6cfd.jpg not downloaded yet
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_a659a28c03e0f995ae1fb04b80c92814.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_a659a28c03e0f995ae1fb04b80c92814.jpg not downloaded yet
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e4450>
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_0107b1b4a0716c77f58f5ba6157bbbaa.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0107b1b4a0716c77f58f5ba6157bbbaa.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b6950>
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_17b0bed2693b2d15b7bc67be35b0d664.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_17b0bed2693b2d15b7bc67be35b0d664.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f7050>
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_3cb8b8c844b03a41376633526b84de8f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_3cb8b8c844b03a41376633526b84de8f.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c922d0>
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_d8bb1c635b08554e36145574cf4a0d2f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_d8bb1c635b08554e36145574cf4a0d2f.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dba750>
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fb6%252F4bb6b28b2d8e3d2f3fdc982853f83aee%252Fpa%252FYP74524_e740cb658637e6892d7d04aefaa2aa9f.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e740cb658637e6892d7d04aefaa2aa9f.jpg saved to cache
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb
2026-03-27 20:38:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb, skipping ID generation
2026-03-27 20:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with scrape type 1
2026-03-27 20:38:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb sending to next pipeline
2026-03-27 20:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb, identifier: YP74524
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032dbe50>
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_7ca73275c30e0c3d8ad16e578854c290.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7ca73275c30e0c3d8ad16e578854c290.jpg saved to cache
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-27 20:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524
2026-03-27 20:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 87de171a-a0af-5ac6-8ec6-06d1f91ec5bb with identifier: YP74524 to the API
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e740cb658637e6892d7d04aefaa2aa9f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:48:17Z',
 'fuel_type': 'hybrid',
 'id': '87de171a-a0af-5ac6-8ec6-06d1f91ec5bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP74524',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 101969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42452,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_57ceeaf8f62e3b18300f70ecc45685b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394303,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_040c077ab5eecc993baa0aac51b89481.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378659,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_179e2279ca704f82d4200b717f215889.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388658,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e740cb658637e6892d7d04aefaa2aa9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358040,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_d8bb1c635b08554e36145574cf4a0d2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377244,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_3cb8b8c844b03a41376633526b84de8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393269,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_e686ef6c0c365c54f3bcb5ea49cbc6e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369781,
             'Height': 1358,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_ddd28a4f48b0ea84ede58b5892736659.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364015,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_11b35c6d52e1fb5c436afb885e15ffc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87de171a-a0af-5ac6-8ec6-06d1f91ec5bb/87de171a-a0af-5ac6-8ec6-06d1f91ec5bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37437,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/b6/4bb6b28b2d8e3d2f3fdc982853f83aee/pa/YP74524_5bb41b66a59ef8b004486db2239efe20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [auto1.be] INFO: Saving data for YP74524: {'created_time': 1774643921.33578, 'last_price_update_time': 1774643921.335792, 'auction_closing_time': 1774716497.0}
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YP74524') HTTP/1.1" 204 0
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_012682038af60cf77d452acdd52e3624.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_012682038af60cf77d452acdd52e3624.jpg not downloaded yet
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ47044> (referer: https://www.auto1.com/v1/car-details-view/ZZ47044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR50529> (referer: https://www.auto1.com/v1/car-details-view/FR50529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS70966> (referer: https://www.auto1.com/v1/car-details-view/VS70966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_fc7064dd144ac00ae17d3ad853035662.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_32ca8034ccd4ac129cccbd99c71cfd17.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_932ef450542c50ff7fe3e7db482e3fcf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_1fdf19a2cd34b93eff61b33e88bd0669.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_2fccceae103f5a53583a684543fd605d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_d7f63c3dd55a6c673013ccb799875d1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_ea81ec18d5dfa8938d23e996bf42bc2a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_012682038af60cf77d452acdd52e3624.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-27 20:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76329f7b-2ec6-53ed-928c-109f9d364699 with scrape type 1
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 76329f7b-2ec6-53ed-928c-109f9d364699
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_2de8212348275120d76d9e6c242dd315.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_2de8212348275120d76d9e6c242dd315.jpg not downloaded yet
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7a5c9a497aa4e110c0f76610950a6cfd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_a659a28c03e0f995ae1fb04b80c92814.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_dc109fc890f7d81aab05935f3a4bdeed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_dc109fc890f7d81aab05935f3a4bdeed.jpg not downloaded yet
2026-03-27 20:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-27 20:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b3ee22-69db-552c-8395-dc8bade66c5b with scrape type 1
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_b9b85e61875001d50d9fd01a21db266a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b9b85e61875001d50d9fd01a21db266a.jpg not downloaded yet
2026-03-27 20:38:41 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1659 | hits on page: 40
2026-03-27 20:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7304f2af-7207-561f-8a83-431906cf1f30 with identifier: VS70966
2026-03-27 20:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7304f2af-7207-561f-8a83-431906cf1f30 with scrape type 1
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_6ee3daf323dcd286bc1307ebf908ece5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_6ee3daf323dcd286bc1307ebf908ece5.jpg not downloaded yet
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_0bd501fef31a3a34bd0445474256c942.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_4fac707ef398e75361f1dc4683f0f3b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_589444aea0bf289eb3421bf0a754e4db.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_334bbf972e78917fdf642d014aa79343.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_334bbf972e78917fdf642d014aa79343.jpg not downloaded yet
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_7b87897982836167d535bc2964104080.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7b87897982836167d535bc2964104080.jpg not downloaded yet
2026-03-27 20:38:41 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [auto1.be] INFO: Scrape type for VZ78935: 1
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_87a2708f29707b52fbd50e2bff89c1a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_87a2708f29707b52fbd50e2bff89c1a6.jpg not downloaded yet
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eef510>
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_fc7064dd144ac00ae17d3ad853035662.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_fc7064dd144ac00ae17d3ad853035662.jpg saved to cache
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d9b950>
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_32ca8034ccd4ac129cccbd99c71cfd17.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_32ca8034ccd4ac129cccbd99c71cfd17.jpg saved to cache
2026-03-27 20:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:38:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:38:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:38:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:38:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e4c850>
2026-03-27 20:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F36%252F63360e435fd8150efb75524c1b568a4a%252Fpa%252FTX40265_932ef450542c50ff7fe3e7db482e3fcf.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_932ef450542c50ff7fe3e7db482e3fcf.jpg saved to cache
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb74d561-fe35-51dc-afbc-3d7048a98f74
2026-03-27 20:38:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb74d561-fe35-51dc-afbc-3d7048a98f74, skipping ID generation
2026-03-27 20:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb74d561-fe35-51dc-afbc-3d7048a98f74 with scrape type 1
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb74d561-fe35-51dc-afbc-3d7048a98f74 sending to next pipeline
2026-03-27 20:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb74d561-fe35-51dc-afbc-3d7048a98f74, identifier: TX40265
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032db390>
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_1fdf19a2cd34b93eff61b33e88bd0669.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_1fdf19a2cd34b93eff61b33e88bd0669.jpg saved to cache
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9121e1690>
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_2fccceae103f5a53583a684543fd605d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_2fccceae103f5a53583a684543fd605d.jpg saved to cache
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903232b90>
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_d7f63c3dd55a6c673013ccb799875d1d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_d7f63c3dd55a6c673013ccb799875d1d.jpg saved to cache
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e2fd0>
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_ea81ec18d5dfa8938d23e996bf42bc2a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_ea81ec18d5dfa8938d23e996bf42bc2a.jpg saved to cache
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032da890>
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_012682038af60cf77d452acdd52e3624.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_012682038af60cf77d452acdd52e3624.jpg saved to cache
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_f2909fa067106b8800a6e629eb4c0333.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_f2909fa067106b8800a6e629eb4c0333.jpg not downloaded yet
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_bcbfdac33c63646bc003232b11ec88f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_bcbfdac33c63646bc003232b11ec88f6.jpg not downloaded yet
2026-03-27 20:38:42 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-27 20:38:42 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-27 20:38:42 [auto1.be] INFO: Scrape type for NW54949: 1
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_db93a0df5690ab8a2a9ec1092467b2b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_db93a0df5690ab8a2a9ec1092467b2b1.jpg not downloaded yet
2026-03-27 20:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-27 20:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-27 20:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265 to the API
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_932ef450542c50ff7fe3e7db482e3fcf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:36:25Z',
 'fuel_type': 'petrol',
 'id': 'fb74d561-fe35-51dc-afbc-3d7048a98f74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40265',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 203613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190368,
             'Height': 4284,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_932ef450542c50ff7fe3e7db482e3fcf.jpg',
             'Width': 5712},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_cf5b176dbb0b832136ab4c8252bf0f89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0c4832c3a2ef6b8220d9e0b8b65ff512.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_ca4f54825636fbad65f0fce2947dfafd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_0107b1b4a0716c77f58f5ba6157bbbaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_17b0bed2693b2d15b7bc67be35b0d664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_324933697f237f52a0c6ef628c9d8473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_f1b9d71cfb35c83359fdbaf1c8f72034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_5c5f60856e3667c3317c94154c45be2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb74d561-fe35-51dc-afbc-3d7048a98f74/fb74d561-fe35-51dc-afbc-3d7048a98f74_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/36/63360e435fd8150efb75524c1b568a4a/pa/TX40265_be626ae0b3e39417451e8f7e05702881.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [auto1.be] INFO: Saving data for TX40265: {'created_time': 1774643923.234122, 'last_price_update_time': 1774643923.234133, 'auction_closing_time': 1774715785.0}
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX40265') HTTP/1.1" 204 0
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c6d5d0>
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_7a5c9a497aa4e110c0f76610950a6cfd.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7a5c9a497aa4e110c0f76610950a6cfd.jpg saved to cache
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ee2bd0>
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_a659a28c03e0f995ae1fb04b80c92814.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_a659a28c03e0f995ae1fb04b80c92814.jpg saved to cache
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ee1050>
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_0bd501fef31a3a34bd0445474256c942.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_0bd501fef31a3a34bd0445474256c942.jpg saved to cache
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_83d335d55e4acb2a49a34f0579338c2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_83d335d55e4acb2a49a34f0579338c2c.jpg not downloaded yet
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_1c66f7bb563c8634bb68f81a2cafdded.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_1c66f7bb563c8634bb68f81a2cafdded.jpg not downloaded yet
2026-03-27 20:38:43 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [auto1.be] INFO: Scrape type for LG48907: 1
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_1a05a331e3b3dd631a82d5569d93c5ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_1a05a331e3b3dd631a82d5569d93c5ab.jpg not downloaded yet
2026-03-27 20:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY09771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL87249> (referer: https://www.auto1.com/v1/car-details-view/EL87249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903288690>
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_4fac707ef398e75361f1dc4683f0f3b5.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_4fac707ef398e75361f1dc4683f0f3b5.jpg saved to cache
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe91210e310>
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F6c%252F126cb076a0678efca31d4bbfe2bfe03d%252Fpa%252FCE21828_589444aea0bf289eb3421bf0a754e4db.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_589444aea0bf289eb3421bf0a754e4db.jpg saved to cache
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a979e851-3c77-51f1-b728-a0cacafea257
2026-03-27 20:38:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a979e851-3c77-51f1-b728-a0cacafea257, skipping ID generation
2026-03-27 20:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a979e851-3c77-51f1-b728-a0cacafea257 with scrape type 1
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a979e851-3c77-51f1-b728-a0cacafea257 sending to next pipeline
2026-03-27 20:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a979e851-3c77-51f1-b728-a0cacafea257, identifier: CE21828
2026-03-27 20:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_387602c34c2f207d6155402f13344b9c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_b1cd1e53ddf9741638af8345081461a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_b1cd1e53ddf9741638af8345081461a5.jpg not downloaded yet
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_c7d21beafc9acbd0677a8260b8ccf51e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_c7d21beafc9acbd0677a8260b8ccf51e.jpg not downloaded yet
2026-03-27 20:38:43 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [auto1.be] INFO: Scrape type for JY53618: 2
2026-03-27 20:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-27 20:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 092b285f-2a02-5153-bb1b-d65a1605d8cd with scrape type 2
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 092b285f-2a02-5153-bb1b-d65a1605d8cd with scrape type 2
2026-03-27 20:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 092b285f-2a02-5153-bb1b-d65a1605d8cd, identifier: JY53618
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_90706f5b0d46f3ae57989dedd26d3131.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_90706f5b0d46f3ae57989dedd26d3131.jpg not downloaded yet
2026-03-27 20:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a979e851-3c77-51f1-b728-a0cacafea257 with identifier: CE21828
2026-03-27 20:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a979e851-3c77-51f1-b728-a0cacafea257 with identifier: CE21828
2026-03-27 20:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a979e851-3c77-51f1-b728-a0cacafea257 with identifier: CE21828 to the API
2026-03-27 20:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_589444aea0bf289eb3421bf0a754e4db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:17:39Z',
 'fuel_type': 'hybrid',
 'id': 'a979e851-3c77-51f1-b728-a0cacafea257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE21828',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 27670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44881,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7ca73275c30e0c3d8ad16e578854c290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382781,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_fc7064dd144ac00ae17d3ad853035662.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364301,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_32ca8034ccd4ac129cccbd99c71cfd17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385529,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_4fac707ef398e75361f1dc4683f0f3b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326227,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_589444aea0bf289eb3421bf0a754e4db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345438,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_1fdf19a2cd34b93eff61b33e88bd0669.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385956,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_0bd501fef31a3a34bd0445474256c942.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45872,
             'Height': 530,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_7a5c9a497aa4e110c0f76610950a6cfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336987,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_a659a28c03e0f995ae1fb04b80c92814.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a979e851-3c77-51f1-b728-a0cacafea257/a979e851-3c77-51f1-b728-a0cacafea257_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40239,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img12/6c/126cb076a0678efca31d4bbfe2bfe03d/pa/CE21828_012682038af60cf77d452acdd52e3624.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2023}
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE21828%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [auto1.be] INFO: Saving data for CE21828: {'created_time': 1774643924.180804, 'last_price_update_time': 1774643924.180816, 'auction_closing_time': 1774714659.0}
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE21828') HTTP/1.1" 204 0
2026-03-27 20:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-27 20:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618
2026-03-27 20:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 092b285f-2a02-5153-bb1b-d65a1605d8cd with identifier: JY53618 to the API
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:12:56Z',
 'fuel_type': 'diesel',
 'id': '092b285f-2a02-5153-bb1b-d65a1605d8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY53618',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 114433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Ford Transit 1.8 TDCi Kasten Lang Trend',
 'transmission': 'manual',
 'trim': 'Kasten Lang Trend',
 'year': 2013}
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [auto1.be] INFO: Saving data for JY53618: {'auction_closing_time': 1774714376.0, 'created_time': 1773866710.151487, 'last_price_update_time': 1774643924.536787}
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY53618') HTTP/1.1" 204 0
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_cc09c0f8c53bfd6d38876830595e769e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_cc09c0f8c53bfd6d38876830595e769e.jpg not downloaded yet
2026-03-27 20:38:44 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-27 20:38:44 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-27 20:38:44 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [auto1.be] INFO: Scrape type for AY47657: 2
2026-03-27 20:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-27 20:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with scrape type 2
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with scrape type 2
2026-03-27 20:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb, identifier: AY47657
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_8d77af6f4cbce4015ff32e044457541e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_8d77af6f4cbce4015ff32e044457541e.jpg not downloaded yet
2026-03-27 20:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887363c6-a08a-533a-9a18-ce7743d56295 with identifier: EL87249
2026-03-27 20:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887363c6-a08a-533a-9a18-ce7743d56295 with scrape type 1
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 887363c6-a08a-533a-9a18-ce7743d56295
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_df7af85c30648d8003a65f02553caf78.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_df7af85c30648d8003a65f02553caf78.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_a0b454fd9438efdc589150e4b4999c10.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_a0b454fd9438efdc589150e4b4999c10.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_8969cb8ab45e9c2f2a74034be6103a14.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_8969cb8ab45e9c2f2a74034be6103a14.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_f9aacce2f1f6e20b1996ce16bbbdcaa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_f9aacce2f1f6e20b1996ce16bbbdcaa6.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_85b2ac1ed94dac82da3ee1c37999d89f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_85b2ac1ed94dac82da3ee1c37999d89f.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_3879c61c1f3fbd3a734cd682721aa778.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_3879c61c1f3fbd3a734cd682721aa778.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_397e32192321394ea7350c9ba9331da9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_397e32192321394ea7350c9ba9331da9.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_2a145f86035e3ad43f5c06003877b244.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_2a145f86035e3ad43f5c06003877b244.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_fce2ff881717d76d2b18c41cc20bd4cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_fce2ff881717d76d2b18c41cc20bd4cd.jpg already downloaded
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F19%252F6d1962e144c92d1b114108bbaf47582b%252Fpa%252FEL87249_3ec83418e4ea4b4771d466e3782642ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_3ec83418e4ea4b4771d466e3782642ac.jpg already downloaded
2026-03-27 20:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 887363c6-a08a-533a-9a18-ce7743d56295, identifier: EL87249
2026-03-27 20:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_f2909fa067106b8800a6e629eb4c0333.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_87a2708f29707b52fbd50e2bff89c1a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_db93a0df5690ab8a2a9ec1092467b2b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_334bbf972e78917fdf642d014aa79343.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-27 20:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657
2026-03-27 20:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5c2b53d-f5e2-5f18-8ab6-cff861f912fb with identifier: AY47657 to the API
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:47:23Z',
 'fuel_type': 'petrol',
 'id': 'c5c2b53d-f5e2-5f18-8ab6-cff861f912fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY47657',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 94952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [auto1.be] INFO: Saving data for AY47657: {'auction_closing_time': 1774716443.0, 'created_time': 1773434531.165153, 'last_price_update_time': 1774643925.253096}
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY47657') HTTP/1.1" 204 0
2026-03-27 20:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ85942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 887363c6-a08a-533a-9a18-ce7743d56295 with identifier: EL87249
2026-03-27 20:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 887363c6-a08a-533a-9a18-ce7743d56295 with identifier: EL87249
2026-03-27 20:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 887363c6-a08a-533a-9a18-ce7743d56295 with identifier: EL87249 to the API
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL87249>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:07:18Z',
 'fuel_type': 'petrol',
 'id': '887363c6-a08a-533a-9a18-ce7743d56295',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL87249',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 122042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_df7af85c30648d8003a65f02553caf78.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_a0b454fd9438efdc589150e4b4999c10.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_8969cb8ab45e9c2f2a74034be6103a14.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_f9aacce2f1f6e20b1996ce16bbbdcaa6.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_85b2ac1ed94dac82da3ee1c37999d89f.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_3879c61c1f3fbd3a734cd682721aa778.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_397e32192321394ea7350c9ba9331da9.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_2a145f86035e3ad43f5c06003877b244.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_fce2ff881717d76d2b18c41cc20bd4cd.jpg',
                'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_3ec83418e4ea4b4771d466e3782642ac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_df7af85c30648d8003a65f02553caf78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_a0b454fd9438efdc589150e4b4999c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_8969cb8ab45e9c2f2a74034be6103a14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_f9aacce2f1f6e20b1996ce16bbbdcaa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_85b2ac1ed94dac82da3ee1c37999d89f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_3879c61c1f3fbd3a734cd682721aa778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_397e32192321394ea7350c9ba9331da9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_2a145f86035e3ad43f5c06003877b244.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_fce2ff881717d76d2b18c41cc20bd4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887363c6-a08a-533a-9a18-ce7743d56295/887363c6-a08a-533a-9a18-ce7743d56295_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/19/6d1962e144c92d1b114108bbaf47582b/pa/EL87249_3ec83418e4ea4b4771d466e3782642ac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL87249%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [auto1.be] INFO: Saving data for EL87249: {'created_time': 1774643925.568951, 'last_price_update_time': 1774643925.568961, 'auction_closing_time': 1774714038.0}
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL87249') HTTP/1.1" 204 0
2026-03-27 20:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_6ee3daf323dcd286bc1307ebf908ece5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_86e4e931d5cd704eeea8103293f906c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_86e4e931d5cd704eeea8103293f906c0.jpg not downloaded yet
2026-03-27 20:38:45 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [auto1.be] INFO: Scrape type for FE88671: 1
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_02315381c22ebad621a0f92fd04d4b4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_02315381c22ebad621a0f92fd04d4b4a.jpg not downloaded yet
2026-03-27 20:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c5c850>
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_387602c34c2f207d6155402f13344b9c.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_387602c34c2f207d6155402f13344b9c.jpg saved to cache
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_bcbfdac33c63646bc003232b11ec88f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_7a89edd3f3d2956678519104bfc82309.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7a89edd3f3d2956678519104bfc82309.jpg not downloaded yet
2026-03-27 20:38:45 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW24606%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [auto1.be] INFO: Scrape type for WW24606: 1
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_b32ad92f73c3ca122ee65b1ecca057b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_b32ad92f73c3ca122ee65b1ecca057b9.jpg not downloaded yet
2026-03-27 20:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC93215/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL17322/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903231cd0>
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_f2909fa067106b8800a6e629eb4c0333.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_f2909fa067106b8800a6e629eb4c0333.jpg saved to cache
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76329f7b-2ec6-53ed-928c-109f9d364699
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903335f10>
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_87a2708f29707b52fbd50e2bff89c1a6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_87a2708f29707b52fbd50e2bff89c1a6.jpg saved to cache
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911dd2210>
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_db93a0df5690ab8a2a9ec1092467b2b1.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_db93a0df5690ab8a2a9ec1092467b2b1.jpg saved to cache
2026-03-27 20:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce5890>
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_334bbf972e78917fdf642d014aa79343.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_334bbf972e78917fdf642d014aa79343.jpg saved to cache
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76329f7b-2ec6-53ed-928c-109f9d364699
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc6d90>
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_6ee3daf323dcd286bc1307ebf908ece5.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_6ee3daf323dcd286bc1307ebf908ece5.jpg saved to cache
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_5484c9c80c48d3678c9466c1cb564272.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_5484c9c80c48d3678c9466c1cb564272.jpg not downloaded yet
2026-03-27 20:38:46 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-27 20:38:46 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-27 20:38:46 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF96553%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [auto1.be] INFO: Scrape type for VF96553: 1
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_81ddf98032ba3933ea66994505d702b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_81ddf98032ba3933ea66994505d702b1.jpg not downloaded yet
2026-03-27 20:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_1a05a331e3b3dd631a82d5569d93c5ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_90706f5b0d46f3ae57989dedd26d3131.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_8d77af6f4cbce4015ff32e044457541e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_b59bf518ce1bf6a2705d8036aa614e10.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b59bf518ce1bf6a2705d8036aa614e10.jpg not downloaded yet
2026-03-27 20:38:46 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR55859%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [auto1.be] INFO: Scrape type for TR55859: 1
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_be250c45990f1dfe1232ee7e47acc6fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_be250c45990f1dfe1232ee7e47acc6fe.jpg not downloaded yet
2026-03-27 20:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032cf510>
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_bcbfdac33c63646bc003232b11ec88f6.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_bcbfdac33c63646bc003232b11ec88f6.jpg saved to cache
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_cc09c0f8c53bfd6d38876830595e769e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:46 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [auto1.be] INFO: Scrape type for FE56390: 2
2026-03-27 20:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-27 20:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b50d0127-601a-5821-98ae-9af60a6c557f with scrape type 2
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b50d0127-601a-5821-98ae-9af60a6c557f with scrape type 2
2026-03-27 20:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b50d0127-601a-5821-98ae-9af60a6c557f, identifier: FE56390
2026-03-27 20:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-27 20:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390
2026-03-27 20:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b50d0127-601a-5821-98ae-9af60a6c557f with identifier: FE56390 to the API
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:15:44Z',
 'fuel_type': 'diesel',
 'id': 'b50d0127-601a-5821-98ae-9af60a6c557f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE56390',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 40092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2023}
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [auto1.be] INFO: Saving data for FE56390: {'auction_closing_time': 1774714544.0, 'created_time': 1773866677.280469, 'last_price_update_time': 1774643926.65617}
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE56390') HTTP/1.1" 204 0
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc1810>
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_1a05a331e3b3dd631a82d5569d93c5ab.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_1a05a331e3b3dd631a82d5569d93c5ab.jpg saved to cache
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e59790>
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_90706f5b0d46f3ae57989dedd26d3131.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_90706f5b0d46f3ae57989dedd26d3131.jpg saved to cache
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fde450>
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_8d77af6f4cbce4015ff32e044457541e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_8d77af6f4cbce4015ff32e044457541e.jpg saved to cache
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_c7d21beafc9acbd0677a8260b8ccf51e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:46 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-27 20:38:46 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-27 20:38:46 [auto1.be] INFO: Scrape type for CU87114: 2
2026-03-27 20:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-27 20:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with scrape type 2
2026-03-27 20:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with scrape type 2
2026-03-27 20:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050, identifier: CU87114
2026-03-27 20:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_02315381c22ebad621a0f92fd04d4b4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_b1cd1e53ddf9741638af8345081461a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-27 20:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114
2026-03-27 20:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75dcc80f-8bf9-5b99-a0ef-027f97a8b050 with identifier: CU87114 to the API
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:28Z',
 'fuel_type': 'petrol',
 'id': '75dcc80f-8bf9-5b99-a0ef-027f97a8b050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU87114',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 17473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2021}
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [auto1.be] INFO: Saving data for CU87114: {'auction_closing_time': 1774715428.0, 'created_time': 1773520652.9053, 'last_price_update_time': 1774643927.326101}
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU87114') HTTP/1.1" 204 0
2026-03-27 20:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f60790>
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_cc09c0f8c53bfd6d38876830595e769e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_cc09c0f8c53bfd6d38876830595e769e.jpg saved to cache
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_81ddf98032ba3933ea66994505d702b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL68944%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [auto1.be] INFO: Scrape type for SL68944: 1
2026-03-27 20:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_86e4e931d5cd704eeea8103293f906c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d41850>
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_c7d21beafc9acbd0677a8260b8ccf51e.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_c7d21beafc9acbd0677a8260b8ccf51e.jpg saved to cache
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [auto1.be] INFO: Scrape type for UW52037: 1
2026-03-27 20:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY09771> (referer: https://www.auto1.com/v1/car-details-view/HY09771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW54949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903db0d90>
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_02315381c22ebad621a0f92fd04d4b4a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_02315381c22ebad621a0f92fd04d4b4a.jpg saved to cache
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90331fd50>
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_b1cd1e53ddf9741638af8345081461a5.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_b1cd1e53ddf9741638af8345081461a5.jpg saved to cache
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76329f7b-2ec6-53ed-928c-109f9d364699
2026-03-27 20:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_be250c45990f1dfe1232ee7e47acc6fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [auto1.be] INFO: Scrape type for RS46918: 1
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP59959%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [auto1.be] INFO: Scrape type for CP59959: 1
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d04890>
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_81ddf98032ba3933ea66994505d702b1.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_81ddf98032ba3933ea66994505d702b1.jpg saved to cache
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cae950>
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_86e4e931d5cd704eeea8103293f906c0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_86e4e931d5cd704eeea8103293f906c0.jpg saved to cache
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [auto1.be] INFO: Scrape type for ZJ47299: 1
2026-03-27 20:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb53b1f5-1571-55c4-a204-54bb00ae9e30 with identifier: HY09771
2026-03-27 20:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb53b1f5-1571-55c4-a204-54bb00ae9e30 with scrape type 1
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cb53b1f5-1571-55c4-a204-54bb00ae9e30
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_12d39436dd519d98970a6ab0addfe254.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_12d39436dd519d98970a6ab0addfe254.jpg not downloaded yet
2026-03-27 20:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_b32ad92f73c3ca122ee65b1ecca057b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b59bf518ce1bf6a2705d8036aa614e10.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:47 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU40891%27 HTTP/1.1" 200 None
2026-03-27 20:38:47 [auto1.be] INFO: Scrape type for ZU40891: 1
2026-03-27 20:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_b362db973239d72eecb3085493760be3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_b362db973239d72eecb3085493760be3.jpg not downloaded yet
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903241810>
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_be250c45990f1dfe1232ee7e47acc6fe.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_be250c45990f1dfe1232ee7e47acc6fe.jpg saved to cache
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:48 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-27 20:38:48 [auto1.be] INFO: Scrape type for JZ16543: 1
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_14fe48914e67aa137cbe820aa829b0d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_14fe48914e67aa137cbe820aa829b0d7.jpg not downloaded yet
2026-03-27 20:38:48 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM95515%27 HTTP/1.1" 200 None
2026-03-27 20:38:48 [auto1.be] INFO: Scrape type for PM95515: 1
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_a53563a79fc863e42fb74a53a90be743.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_a53563a79fc863e42fb74a53a90be743.jpg not downloaded yet
2026-03-27 20:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE88671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:48 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-27 20:38:48 [auto1.be] INFO: Scrape type for HT10085: 1
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_0e7cfe49e0e5b11607df54f58a766b83.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_0e7cfe49e0e5b11607df54f58a766b83.jpg not downloaded yet
2026-03-27 20:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f5110>
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Ff9%252F4ff9e22865a1512ed398094625ee3de0%252Fpa%252FVS70966_b32ad92f73c3ca122ee65b1ecca057b9.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_b32ad92f73c3ca122ee65b1ecca057b9.jpg saved to cache
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7304f2af-7207-561f-8a83-431906cf1f30
2026-03-27 20:38:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7304f2af-7207-561f-8a83-431906cf1f30, skipping ID generation
2026-03-27 20:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7304f2af-7207-561f-8a83-431906cf1f30 with scrape type 1
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7304f2af-7207-561f-8a83-431906cf1f30 sending to next pipeline
2026-03-27 20:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7304f2af-7207-561f-8a83-431906cf1f30, identifier: VS70966
2026-03-27 20:38:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f2bd0>
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_b59bf518ce1bf6a2705d8036aa614e10.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b59bf518ce1bf6a2705d8036aa614e10.jpg saved to cache
2026-03-27 20:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7304f2af-7207-561f-8a83-431906cf1f30 with identifier: VS70966
2026-03-27 20:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7304f2af-7207-561f-8a83-431906cf1f30 with identifier: VS70966
2026-03-27 20:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7304f2af-7207-561f-8a83-431906cf1f30 with identifier: VS70966 to the API
2026-03-27 20:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_b32ad92f73c3ca122ee65b1ecca057b9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:48:05Z',
 'fuel_type': 'diesel',
 'id': '7304f2af-7207-561f-8a83-431906cf1f30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS70966',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 254255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_6ee3daf323dcd286bc1307ebf908ece5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_87a2708f29707b52fbd50e2bff89c1a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_db93a0df5690ab8a2a9ec1092467b2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_1a05a331e3b3dd631a82d5569d93c5ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_90706f5b0d46f3ae57989dedd26d3131.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_8d77af6f4cbce4015ff32e044457541e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_02315381c22ebad621a0f92fd04d4b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_b32ad92f73c3ca122ee65b1ecca057b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_81ddf98032ba3933ea66994505d702b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7304f2af-7207-561f-8a83-431906cf1f30/7304f2af-7207-561f-8a83-431906cf1f30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/f9/4ff9e22865a1512ed398094625ee3de0/pa/VS70966_be250c45990f1dfe1232ee7e47acc6fe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS70966%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Saving data for VS70966: {'created_time': 1774643929.672973, 'last_price_update_time': 1774643929.672982, 'auction_closing_time': 1774716485.0}
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VS70966') HTTP/1.1" 204 0
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Scrape type for VA32651: 1
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_465f533195bd78334b15c618b9df048d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_465f533195bd78334b15c618b9df048d.jpg not downloaded yet
2026-03-27 20:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ78935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR55859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ85942> (referer: https://www.auto1.com/v1/car-details-view/WJ85942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Scrape type for YT15018: 1
2026-03-27 20:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL17322> (referer: https://www.auto1.com/v1/car-details-view/DL17322/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF96553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC93215> (referer: https://www.auto1.com/v1/car-details-view/JC93215/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:49 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1659 | hits on page: 40
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_a53563a79fc863e42fb74a53a90be743.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA13965%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Scrape type for MA13965: 1
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL31605%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Scrape type for XL31605: 1
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Scrape type for DY96127: 1
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_e35e68985223d816f8036d8684bf4b98.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Scrape type for XB11874: 1
2026-03-27 20:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_0e7cfe49e0e5b11607df54f58a766b83.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-27 20:38:49 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-27 20:38:49 [auto1.be] INFO: Scrape type for YG62523: 1
2026-03-27 20:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_465f533195bd78334b15c618b9df048d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_14fe48914e67aa137cbe820aa829b0d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:50 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [auto1.be] INFO: Scrape type for DP96261: 2
2026-03-27 20:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-27 20:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9e1707-ded2-5554-ba55-00530f25d636 with scrape type 2
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9e1707-ded2-5554-ba55-00530f25d636 with scrape type 2
2026-03-27 20:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a9e1707-ded2-5554-ba55-00530f25d636, identifier: DP96261
2026-03-27 20:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-27 20:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29a99ba-c57d-5253-ae98-692c57ecd3b3 with scrape type 1
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_59317ee5502a373878fc19cb825b6999.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_59317ee5502a373878fc19cb825b6999.jpg not downloaded yet
2026-03-27 20:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-27 20:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261
2026-03-27 20:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a9e1707-ded2-5554-ba55-00530f25d636 with identifier: DP96261 to the API
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:38:51Z',
 'fuel_type': 'petrol',
 'id': '2a9e1707-ded2-5554-ba55-00530f25d636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP96261',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 42409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [auto1.be] INFO: Saving data for DP96261: {'auction_closing_time': 1774715931.0, 'created_time': 1773909329.691701, 'last_price_update_time': 1774643930.410439}
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP96261') HTTP/1.1" 204 0
2026-03-27 20:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7b87897982836167d535bc2964104080.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:50 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [auto1.be] INFO: Scrape type for XZ48466: 1
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_612e073e650017e30856dc36f9c08a57.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_612e073e650017e30856dc36f9c08a57.jpg not downloaded yet
2026-03-27 20:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-27 20:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with scrape type 1
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_b6817fc7e9d8894f392fd82f7bbda09f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b6817fc7e9d8894f392fd82f7bbda09f.jpg not downloaded yet
2026-03-27 20:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-27 20:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eebaf58-74f5-5452-a391-ffcdcee41b69 with scrape type 1
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3eebaf58-74f5-5452-a391-ffcdcee41b69
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_e45e49e387570dacc71fd0dd172fe8f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_e45e49e387570dacc71fd0dd172fe8f9.jpg not downloaded yet
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903da4690>
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_a53563a79fc863e42fb74a53a90be743.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_a53563a79fc863e42fb74a53a90be743.jpg saved to cache
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb53b1f5-1571-55c4-a204-54bb00ae9e30
2026-03-27 20:38:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903172010>
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_e35e68985223d816f8036d8684bf4b98.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_e35e68985223d816f8036d8684bf4b98.jpg saved to cache
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:38:50 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [auto1.be] INFO: Scrape type for BA52354: 2
2026-03-27 20:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-27 20:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with scrape type 2
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with scrape type 2
2026-03-27 20:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f, identifier: BA52354
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_9304e0bb7e6428ecd889ed82d5e7602a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_9304e0bb7e6428ecd889ed82d5e7602a.jpg not downloaded yet
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_bd484a0c5d7138b53eb826a6d7350b14.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bd484a0c5d7138b53eb826a6d7350b14.jpg not downloaded yet
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_781488b736b319985bdc59444c8621de.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_781488b736b319985bdc59444c8621de.jpg not downloaded yet
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903331550>
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_0e7cfe49e0e5b11607df54f58a766b83.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_0e7cfe49e0e5b11607df54f58a766b83.jpg saved to cache
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb53b1f5-1571-55c4-a204-54bb00ae9e30
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912110cd0>
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_465f533195bd78334b15c618b9df048d.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_465f533195bd78334b15c618b9df048d.jpg saved to cache
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb53b1f5-1571-55c4-a204-54bb00ae9e30
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903230390>
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_14fe48914e67aa137cbe820aa829b0d7.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_14fe48914e67aa137cbe820aa829b0d7.jpg saved to cache
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb53b1f5-1571-55c4-a204-54bb00ae9e30
2026-03-27 20:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-27 20:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354
2026-03-27 20:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f with identifier: BA52354 to the API
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:50:57Z',
 'fuel_type': 'petrol',
 'id': '6e496962-d3bd-5b6b-9f1f-0c92c1a1e94f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA52354',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 252394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-10',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-27 20:38:51 [auto1.be] INFO: Saving data for BA52354: {'auction_closing_time': 1774716657.0, 'created_time': 1773434498.091555, 'last_price_update_time': 1774643931.361585}
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA52354') HTTP/1.1" 204 0
2026-03-27 20:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL68944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:51 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-27 20:38:51 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-27 20:38:51 [auto1.be] INFO: Scrape type for RY14212: 2
2026-03-27 20:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-27 20:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 292d0c5d-e39e-5805-8c93-a44125c26007 with scrape type 2
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 292d0c5d-e39e-5805-8c93-a44125c26007 with scrape type 2
2026-03-27 20:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 292d0c5d-e39e-5805-8c93-a44125c26007, identifier: RY14212
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_52056b96dd79b89b0a2c96aed18d7f6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_52056b96dd79b89b0a2c96aed18d7f6e.jpg not downloaded yet
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_0383ade72a954dfdbb4af1712cd1e61a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_0383ade72a954dfdbb4af1712cd1e61a.jpg not downloaded yet
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_7f9f38153610a2a5ab031f41eff77b50.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_7f9f38153610a2a5ab031f41eff77b50.jpg not downloaded yet
2026-03-27 20:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032fa390>
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_7b87897982836167d535bc2964104080.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7b87897982836167d535bc2964104080.jpg saved to cache
2026-03-27 20:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-27 20:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212
2026-03-27 20:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 292d0c5d-e39e-5805-8c93-a44125c26007 with identifier: RY14212 to the API
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:31:45Z',
 'fuel_type': 'petrol',
 'id': '292d0c5d-e39e-5805-8c93-a44125c26007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY14212',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 215442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2016}
2026-03-27 20:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [auto1.be] INFO: Saving data for RY14212: {'auction_closing_time': 1774715505.0, 'created_time': 1773909358.160747, 'last_price_update_time': 1774643932.202473}
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY14212') HTTP/1.1" 204 0
2026-03-27 20:38:52 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM57328%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [auto1.be] INFO: Scrape type for AM57328: 1
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_c8041aa0d193478f39d82b30a0ae84e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_c8041aa0d193478f39d82b30a0ae84e7.jpg not downloaded yet
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_677fa2288d2658cfaf4643d00f15ccc0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_677fa2288d2658cfaf4643d00f15ccc0.jpg not downloaded yet
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_6c3fbb6a958d936f113e0510df56ef73.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_6c3fbb6a958d936f113e0510df56ef73.jpg not downloaded yet
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW52037/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_e45e49e387570dacc71fd0dd172fe8f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:52 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-27 20:38:52 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-27 20:38:52 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV08195%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [auto1.be] INFO: Scrape type for FV08195: 1
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_39c54b07828369b8cc51def7183ba7b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_39c54b07828369b8cc51def7183ba7b6.jpg not downloaded yet
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_2857c57da3182ffd70d4026d748d1b15.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_2857c57da3182ffd70d4026d748d1b15.jpg not downloaded yet
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_b02acad414875831d264a3829879acbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_b02acad414875831d264a3829879acbd.jpg not downloaded yet
2026-03-27 20:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA32651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM95515/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP59959/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT10085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b9b85e61875001d50d9fd01a21db266a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_781488b736b319985bdc59444c8621de.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:52 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-27 20:38:52 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW35881%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [auto1.be] INFO: Scrape type for PW35881: 2
2026-03-27 20:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881
2026-03-27 20:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 441f1025-f35c-5d94-bc95-ce3433032384 with scrape type 2
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 441f1025-f35c-5d94-bc95-ce3433032384 with scrape type 2
2026-03-27 20:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 441f1025-f35c-5d94-bc95-ce3433032384, identifier: PW35881
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_e3200890623275eba17337034b54d86c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e3200890623275eba17337034b54d86c.jpg not downloaded yet
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_04653ec2f265c7b761e009c03f0ad48b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_04653ec2f265c7b761e009c03f0ad48b.jpg not downloaded yet
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_07f75a711a311a3691859f7d66878166.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_07f75a711a311a3691859f7d66878166.jpg not downloaded yet
2026-03-27 20:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881
2026-03-27 20:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881
2026-03-27 20:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881 to the API
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:01:44Z',
 'fuel_type': 'diesel',
 'id': '441f1025-f35c-5d94-bc95-ce3433032384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW35881',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 115085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-24',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 CDTI DPF Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW35881%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [auto1.be] INFO: Saving data for PW35881: {'auction_closing_time': 1774713704.0, 'created_time': 1774006559.949919, 'last_price_update_time': 1774643932.822785}
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PW35881') HTTP/1.1" 204 0
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_677fa2288d2658cfaf4643d00f15ccc0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:52 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG24921%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [auto1.be] INFO: Scrape type for ZG24921: 2
2026-03-27 20:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921
2026-03-27 20:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7479c513-71f9-5ab6-9243-b27df08949cd with scrape type 2
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7479c513-71f9-5ab6-9243-b27df08949cd with scrape type 2
2026-03-27 20:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7479c513-71f9-5ab6-9243-b27df08949cd, identifier: ZG24921
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_572f5fb8c761f463ae2cad555c83485c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_572f5fb8c761f463ae2cad555c83485c.jpg not downloaded yet
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_bdaaf37558489cfc8809360ac7160b3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bdaaf37558489cfc8809360ac7160b3b.jpg not downloaded yet
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_0383ade72a954dfdbb4af1712cd1e61a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_6c3fbb6a958d936f113e0510df56ef73.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921
2026-03-27 20:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921
2026-03-27 20:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921 to the API
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:12:49Z',
 'fuel_type': 'diesel',
 'id': '7479c513-71f9-5ab6-9243-b27df08949cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG24921',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 233764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-29',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG24921%27 HTTP/1.1" 200 None
2026-03-27 20:38:53 [auto1.be] INFO: Saving data for ZG24921: {'auction_closing_time': 1774714369.0, 'created_time': 1774001993.788666, 'last_price_update_time': 1774643933.255893}
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG24921') HTTP/1.1" 204 0
2026-03-27 20:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW54949> (referer: https://www.auto1.com/v1/car-details-view/NW54949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_7f9f38153610a2a5ab031f41eff77b50.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:53 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC38550%27 HTTP/1.1" 200 None
2026-03-27 20:38:53 [auto1.be] INFO: Scrape type for GC38550: 2
2026-03-27 20:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550
2026-03-27 20:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with scrape type 2
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with scrape type 2
2026-03-27 20:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c45876a4-8ec2-5f4e-beca-ae6aa63777e2, identifier: GC38550
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_e9b0f7b5fb3c65a33b70890eede01ab1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e9b0f7b5fb3c65a33b70890eede01ab1.jpg not downloaded yet
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_318e9f13e3e6776642d0b8feeb92e9ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_318e9f13e3e6776642d0b8feeb92e9ca.jpg not downloaded yet
2026-03-27 20:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE88671> (referer: https://www.auto1.com/v1/car-details-view/FE88671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fac710>
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_e45e49e387570dacc71fd0dd172fe8f9.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_e45e49e387570dacc71fd0dd172fe8f9.jpg saved to cache
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3eebaf58-74f5-5452-a391-ffcdcee41b69
2026-03-27 20:38:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e9c8d0>
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_b9b85e61875001d50d9fd01a21db266a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b9b85e61875001d50d9fd01a21db266a.jpg saved to cache
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e48510>
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_781488b736b319985bdc59444c8621de.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_781488b736b319985bdc59444c8621de.jpg saved to cache
2026-03-27 20:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3eebaf58-74f5-5452-a391-ffcdcee41b69
2026-03-27 20:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550
2026-03-27 20:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550
2026-03-27 20:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550 to the API
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:14:35Z',
 'fuel_type': 'diesel',
 'id': 'c45876a4-8ec2-5f4e-beca-ae6aa63777e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC38550',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 188909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-10',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel CRDT Active',
 'transmission': 'manual',
 'trim': 'CRDT Active',
 'year': 2012}
2026-03-27 20:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC38550%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [auto1.be] INFO: Saving data for GC38550: {'auction_closing_time': 1774714475.0, 'created_time': 1774001927.409109, 'last_price_update_time': 1774643934.000691}
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC38550') HTTP/1.1" 204 0
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f85a50>
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_677fa2288d2658cfaf4643d00f15ccc0.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_677fa2288d2658cfaf4643d00f15ccc0.jpg saved to cache
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:54 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-27 20:38:54 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH87974%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [auto1.be] INFO: Scrape type for TH87974: 2
2026-03-27 20:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974
2026-03-27 20:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84ce392-7e68-596c-9551-1b9c05fe1a07 with scrape type 2
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84ce392-7e68-596c-9551-1b9c05fe1a07 with scrape type 2
2026-03-27 20:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d84ce392-7e68-596c-9551-1b9c05fe1a07, identifier: TH87974
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_25fd0e4975ba040037ab1ed0088e87a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_25fd0e4975ba040037ab1ed0088e87a8.jpg not downloaded yet
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_eee9ea282b6cc01c1b06686aff0f8ce9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_eee9ea282b6cc01c1b06686aff0f8ce9.jpg not downloaded yet
2026-03-27 20:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_c8041aa0d193478f39d82b30a0ae84e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_04653ec2f265c7b761e009c03f0ad48b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_07f75a711a311a3691859f7d66878166.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974
2026-03-27 20:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974
2026-03-27 20:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974 to the API
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:38:54Z',
 'fuel_type': 'petrol',
 'id': 'd84ce392-7e68-596c-9551-1b9c05fe1a07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH87974',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH87974%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [auto1.be] INFO: Saving data for TH87974: {'auction_closing_time': 1774715934.0, 'created_time': 1774006559.585328, 'last_price_update_time': 1774643934.524082}
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH87974') HTTP/1.1" 204 0
2026-03-27 20:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033e3390>
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_0383ade72a954dfdbb4af1712cd1e61a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_0383ade72a954dfdbb4af1712cd1e61a.jpg saved to cache
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032b3290>
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_6c3fbb6a958d936f113e0510df56ef73.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_6c3fbb6a958d936f113e0510df56ef73.jpg saved to cache
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3eebaf58-74f5-5452-a391-ffcdcee41b69
2026-03-27 20:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-27 20:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff1ab37-6112-5b13-a202-a694b65a0e9c with scrape type 1
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ff1ab37-6112-5b13-a202-a694b65a0e9c
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_0291c016c32e005a05f191a9dc2b4ef2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_0291c016c32e005a05f191a9dc2b4ef2.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_31a4453cb1eaabd14a534220b1b77264.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_31a4453cb1eaabd14a534220b1b77264.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_a2b1a833eefbfac2155b72ffc1be2738.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_a2b1a833eefbfac2155b72ffc1be2738.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_574128dffa7623b6d88082bcf9995453.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_574128dffa7623b6d88082bcf9995453.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_be5690b0c28f9065750c7e564345a0e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_be5690b0c28f9065750c7e564345a0e5.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_31417447ce196fc0fdbd8f3aeeac0d58.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_31417447ce196fc0fdbd8f3aeeac0d58.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_c42c497d081638001d9c419910e11cb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_c42c497d081638001d9c419910e11cb3.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_7ce96a3c1c1c663ae7746a85db3ca024.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_7ce96a3c1c1c663ae7746a85db3ca024.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_af8013ea625a75491c82cbf37e53060e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_af8013ea625a75491c82cbf37e53060e.jpg already downloaded
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F48%252F6d488b073ead165b0b1e44531f060251%252Fpa%252FNW54949_0998ef62823130d44ecbe9f453331dbb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_0998ef62823130d44ecbe9f453331dbb.jpg already downloaded
2026-03-27 20:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ff1ab37-6112-5b13-a202-a694b65a0e9c, identifier: NW54949
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031155d0>
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_7f9f38153610a2a5ab031f41eff77b50.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_7f9f38153610a2a5ab031f41eff77b50.jpg saved to cache
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3eebaf58-74f5-5452-a391-ffcdcee41b69
2026-03-27 20:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-27 20:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b57a36-f67c-58ea-80bb-01e854084220 with scrape type 1
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_73be5490c3ec046410bfce3ca23d9a5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_73be5490c3ec046410bfce3ca23d9a5a.jpg not downloaded yet
2026-03-27 20:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bdaaf37558489cfc8809360ac7160b3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:54 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-27 20:38:54 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL16576%27 HTTP/1.1" 200 None
2026-03-27 20:38:54 [auto1.be] INFO: Scrape type for XL16576: 2
2026-03-27 20:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576
2026-03-27 20:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a3cb2bb-030f-5abf-9a87-f8788fde121f with scrape type 2
2026-03-27 20:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a3cb2bb-030f-5abf-9a87-f8788fde121f with scrape type 2
2026-03-27 20:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a3cb2bb-030f-5abf-9a87-f8788fde121f, identifier: XL16576
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_b2dabef4e89d7887222a27d49b2c1570.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b2dabef4e89d7887222a27d49b2c1570.jpg not downloaded yet
2026-03-27 20:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-27 20:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949
2026-03-27 20:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ff1ab37-6112-5b13-a202-a694b65a0e9c with identifier: NW54949 to the API
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NW54949>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:29Z',
 'fuel_type': 'diesel',
 'id': '5ff1ab37-6112-5b13-a202-a694b65a0e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW54949',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 117371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_0291c016c32e005a05f191a9dc2b4ef2.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_31a4453cb1eaabd14a534220b1b77264.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_a2b1a833eefbfac2155b72ffc1be2738.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_574128dffa7623b6d88082bcf9995453.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_be5690b0c28f9065750c7e564345a0e5.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_31417447ce196fc0fdbd8f3aeeac0d58.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_c42c497d081638001d9c419910e11cb3.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_7ce96a3c1c1c663ae7746a85db3ca024.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_af8013ea625a75491c82cbf37e53060e.jpg',
                'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_0998ef62823130d44ecbe9f453331dbb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_0291c016c32e005a05f191a9dc2b4ef2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_31a4453cb1eaabd14a534220b1b77264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583613,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_a2b1a833eefbfac2155b72ffc1be2738.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_574128dffa7623b6d88082bcf9995453.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_be5690b0c28f9065750c7e564345a0e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2569960,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_31417447ce196fc0fdbd8f3aeeac0d58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_c42c497d081638001d9c419910e11cb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_7ce96a3c1c1c663ae7746a85db3ca024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560764,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_af8013ea625a75491c82cbf37e53060e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff1ab37-6112-5b13-a202-a694b65a0e9c/5ff1ab37-6112-5b13-a202-a694b65a0e9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920571,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/48/6d488b073ead165b0b1e44531f060251/pa/NW54949_0998ef62823130d44ecbe9f453331dbb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-27 20:38:55 [auto1.be] INFO: Saving data for NW54949: {'created_time': 1774643935.343815, 'last_price_update_time': 1774643935.343824, 'auction_closing_time': 1774715909.0}
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NW54949') HTTP/1.1" 204 0
2026-03-27 20:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_5484c9c80c48d3678c9466c1cb564272.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576
2026-03-27 20:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576
2026-03-27 20:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576 to the API
2026-03-27 20:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:06:03Z',
 'fuel_type': 'diesel',
 'id': '9a3cb2bb-030f-5abf-9a87-f8788fde121f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL16576',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 180809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-30',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL16576%27 HTTP/1.1" 200 None
2026-03-27 20:38:56 [auto1.be] INFO: Saving data for XL16576: {'auction_closing_time': 1774713963.0, 'created_time': 1774001873.369565, 'last_price_update_time': 1774643936.664827}
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL16576') HTTP/1.1" 204 0
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_e55a759e4cd0f8282a3ee39c55e6eb41.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_e55a759e4cd0f8282a3ee39c55e6eb41.jpg not downloaded yet
2026-03-27 20:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT15018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:56 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-27 20:38:56 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-27 20:38:56 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-27 20:38:56 [auto1.be] INFO: Scrape type for LF90651: 2
2026-03-27 20:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-27 20:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bbf32d6-3e0d-599b-a271-8b7b1595182f with scrape type 2
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bbf32d6-3e0d-599b-a271-8b7b1595182f with scrape type 2
2026-03-27 20:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bbf32d6-3e0d-599b-a271-8b7b1595182f, identifier: LF90651
2026-03-27 20:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:38:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:38:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:38:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:38:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903edabd0>
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_c8041aa0d193478f39d82b30a0ae84e7.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_c8041aa0d193478f39d82b30a0ae84e7.jpg saved to cache
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eed610>
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_04653ec2f265c7b761e009c03f0ad48b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_04653ec2f265c7b761e009c03f0ad48b.jpg saved to cache
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eb30d0>
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_07f75a711a311a3691859f7d66878166.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_07f75a711a311a3691859f7d66878166.jpg saved to cache
2026-03-27 20:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3eebaf58-74f5-5452-a391-ffcdcee41b69
2026-03-27 20:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_b02acad414875831d264a3829879acbd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-27 20:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651
2026-03-27 20:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bbf32d6-3e0d-599b-a271-8b7b1595182f with identifier: LF90651 to the API
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:28:22Z',
 'fuel_type': 'petrol',
 'id': '1bbf32d6-3e0d-599b-a271-8b7b1595182f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF90651',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Courier',
 'odometer': 4418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': None,
 'title': 'Ford Transit Courier 1.0 EcoBoost Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-27 20:38:57 [auto1.be] INFO: Saving data for LF90651: {'auction_closing_time': 1774715302.0, 'created_time': 1773953495.093067, 'last_price_update_time': 1774643937.271224}
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF90651') HTTP/1.1" 204 0
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_820af3291d3fa3a9f049d33df1cfa6fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_820af3291d3fa3a9f049d33df1cfa6fc.jpg not downloaded yet
2026-03-27 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG62523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB11874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL31605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY96127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031172d0>
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_bdaaf37558489cfc8809360ac7160b3b.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bdaaf37558489cfc8809360ac7160b3b.jpg saved to cache
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_eee9ea282b6cc01c1b06686aff0f8ce9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:57 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-27 20:38:57 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-27 20:38:57 [auto1.be] INFO: Scrape type for MD04738: 2
2026-03-27 20:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-27 20:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fb81f7-38f0-5f29-acdd-c733dca943cc with scrape type 2
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0fb81f7-38f0-5f29-acdd-c733dca943cc with scrape type 2
2026-03-27 20:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0fb81f7-38f0-5f29-acdd-c733dca943cc, identifier: MD04738
2026-03-27 20:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL68944> (referer: https://www.auto1.com/v1/car-details-view/SL68944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031df850>
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_5484c9c80c48d3678c9466c1cb564272.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_5484c9c80c48d3678c9466c1cb564272.jpg saved to cache
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-27 20:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738
2026-03-27 20:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0fb81f7-38f0-5f29-acdd-c733dca943cc with identifier: MD04738 to the API
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:38:39Z',
 'fuel_type': 'petrol',
 'id': 'c0fb81f7-38f0-5f29-acdd-c733dca943cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD04738',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 43614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-27 20:38:57 [auto1.be] INFO: Saving data for MD04738: {'auction_closing_time': 1774715919.0, 'created_time': 1773650180.943265, 'last_price_update_time': 1774643937.935028}
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD04738') HTTP/1.1" 204 0
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_b73d9ba5fddb0337fd04a90faa276d73.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_b73d9ba5fddb0337fd04a90faa276d73.jpg not downloaded yet
2026-03-27 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_73be5490c3ec046410bfce3ca23d9a5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:57 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-27 20:38:57 [auto1.be] INFO: Scrape type for CW40114: 2
2026-03-27 20:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-27 20:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with scrape type 2
2026-03-27 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with scrape type 2
2026-03-27 20:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae, identifier: CW40114
2026-03-27 20:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f98050>
2026-03-27 20:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fb5%252F3eb5302f403a6d138890e2f44218d5da%252Fpa%252FJC93215_b02acad414875831d264a3829879acbd.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_b02acad414875831d264a3829879acbd.jpg saved to cache
2026-03-27 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3eebaf58-74f5-5452-a391-ffcdcee41b69
2026-03-27 20:38:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3eebaf58-74f5-5452-a391-ffcdcee41b69, skipping ID generation
2026-03-27 20:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eebaf58-74f5-5452-a391-ffcdcee41b69 with scrape type 1
2026-03-27 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3eebaf58-74f5-5452-a391-ffcdcee41b69 sending to next pipeline
2026-03-27 20:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3eebaf58-74f5-5452-a391-ffcdcee41b69, identifier: JC93215
2026-03-27 20:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b2dabef4e89d7887222a27d49b2c1570.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-27 20:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114
2026-03-27 20:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae with identifier: CW40114 to the API
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:07Z',
 'fuel_type': 'petrol',
 'id': '6522f8a9-c9e5-5c2b-b76b-4ad9e14161ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW40114',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 153710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-09',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-27 20:38:58 [auto1.be] INFO: Saving data for CW40114: {'auction_closing_time': 1774715887.0, 'created_time': 1773434141.608684, 'last_price_update_time': 1774643938.553501}
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW40114') HTTP/1.1" 204 0
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_2646b37ddc377d55403b01f888a58970.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_2646b37ddc377d55403b01f888a58970.jpg not downloaded yet
2026-03-27 20:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM57328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-27 20:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215
2026-03-27 20:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3eebaf58-74f5-5452-a391-ffcdcee41b69 with identifier: JC93215 to the API
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_b02acad414875831d264a3829879acbd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '3.9L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-28T16:09:12Z',
 'fuel_type': 'diesel',
 'id': '3eebaf58-74f5-5452-a391-ffcdcee41b69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC93215',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 341195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_e45e49e387570dacc71fd0dd172fe8f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_781488b736b319985bdc59444c8621de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_7f9f38153610a2a5ab031f41eff77b50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_6c3fbb6a958d936f113e0510df56ef73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_b02acad414875831d264a3829879acbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eebaf58-74f5-5452-a391-ffcdcee41b69/3eebaf58-74f5-5452-a391-ffcdcee41b69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/b5/3eb5302f403a6d138890e2f44218d5da/pa/JC93215_07f75a711a311a3691859f7d66878166.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A8 4.0 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2004}
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-27 20:38:58 [auto1.be] INFO: Saving data for JC93215: {'created_time': 1774643938.979034, 'last_price_update_time': 1774643938.979044, 'auction_closing_time': 1774714152.0}
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC93215') HTTP/1.1" 204 0
2026-03-27 20:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033e0350>
2026-03-27 20:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_eee9ea282b6cc01c1b06686aff0f8ce9.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_eee9ea282b6cc01c1b06686aff0f8ce9.jpg saved to cache
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19151025-4cf6-50b1-9d32-e0c8d7b47611 with identifier: SL68944
2026-03-27 20:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19151025-4cf6-50b1-9d32-e0c8d7b47611 with scrape type 1
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19151025-4cf6-50b1-9d32-e0c8d7b47611
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_c5a26fd3d54136ac538782d161e622ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_c5a26fd3d54136ac538782d161e622ac.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_75a72d3315fba689ec0a2bcc0140f9e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_75a72d3315fba689ec0a2bcc0140f9e8.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_63b6a1470f5f89bbb864b89a8c0edd90.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_63b6a1470f5f89bbb864b89a8c0edd90.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_9d041f61c165c65a1c6b7e99b0bda714.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_9d041f61c165c65a1c6b7e99b0bda714.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_1cec9bcccf48cafc170fabc4e9d6970f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_1cec9bcccf48cafc170fabc4e9d6970f.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_ab95d4c9abb34fdf182c0f5dd4cf12c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_ab95d4c9abb34fdf182c0f5dd4cf12c0.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_65e5cb05b0f94214dad4f205c37795a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_65e5cb05b0f94214dad4f205c37795a3.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_17e3f5e2486df8559da1c4f89821e815.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_17e3f5e2486df8559da1c4f89821e815.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_8d2e57a721f34342a7c812fe263a01ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_8d2e57a721f34342a7c812fe263a01ba.jpg already downloaded
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F58%252F1e589b1f92cebaff976d2ed67016d4c8%252Fpa%252FSL68944_4a44dcf21c077658f1e488f45e17e0c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_4a44dcf21c077658f1e488f45e17e0c5.jpg already downloaded
2026-03-27 20:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19151025-4cf6-50b1-9d32-e0c8d7b47611, identifier: SL68944
2026-03-27 20:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_e55a759e4cd0f8282a3ee39c55e6eb41.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:59 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST31185%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [auto1.be] INFO: Scrape type for ST31185: 1
2026-03-27 20:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19151025-4cf6-50b1-9d32-e0c8d7b47611 with identifier: SL68944
2026-03-27 20:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19151025-4cf6-50b1-9d32-e0c8d7b47611 with identifier: SL68944
2026-03-27 20:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19151025-4cf6-50b1-9d32-e0c8d7b47611 with identifier: SL68944 to the API
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL68944>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:38:30Z',
 'fuel_type': 'diesel',
 'id': '19151025-4cf6-50b1-9d32-e0c8d7b47611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL68944',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 159916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 38,
 'photo_urls': ['https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_c5a26fd3d54136ac538782d161e622ac.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_75a72d3315fba689ec0a2bcc0140f9e8.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_63b6a1470f5f89bbb864b89a8c0edd90.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_9d041f61c165c65a1c6b7e99b0bda714.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_1cec9bcccf48cafc170fabc4e9d6970f.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_ab95d4c9abb34fdf182c0f5dd4cf12c0.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_65e5cb05b0f94214dad4f205c37795a3.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_17e3f5e2486df8559da1c4f89821e815.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_8d2e57a721f34342a7c812fe263a01ba.jpg',
                'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_4a44dcf21c077658f1e488f45e17e0c5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_c5a26fd3d54136ac538782d161e622ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_75a72d3315fba689ec0a2bcc0140f9e8.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_63b6a1470f5f89bbb864b89a8c0edd90.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_9d041f61c165c65a1c6b7e99b0bda714.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_1cec9bcccf48cafc170fabc4e9d6970f.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_ab95d4c9abb34fdf182c0f5dd4cf12c0.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_65e5cb05b0f94214dad4f205c37795a3.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_17e3f5e2486df8559da1c4f89821e815.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_8d2e57a721f34342a7c812fe263a01ba.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19151025-4cf6-50b1-9d32-e0c8d7b47611/19151025-4cf6-50b1-9d32-e0c8d7b47611_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/58/1e589b1f92cebaff976d2ed67016d4c8/pa/SL68944_4a44dcf21c077658f1e488f45e17e0c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 12 SX L2H1 130 Multijet',
 'transmission': 'manual',
 'trim': '12 SX L2H1 130 Multijet',
 'year': 2016}
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL68944%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [auto1.be] INFO: Saving data for SL68944: {'created_time': 1774643939.621324, 'last_price_update_time': 1774643939.621335, 'auction_closing_time': 1774715910.0}
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL68944') HTTP/1.1" 204 0
2026-03-27 20:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_318e9f13e3e6776642d0b8feeb92e9ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_978eab22fe5de985ad96cd0bc1c64f1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_978eab22fe5de985ad96cd0bc1c64f1b.jpg not downloaded yet
2026-03-27 20:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031a5f10>
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_73be5490c3ec046410bfce3ca23d9a5a.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_73be5490c3ec046410bfce3ca23d9a5a.jpg saved to cache
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:38:59 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-27 20:38:59 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT92928%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [auto1.be] INFO: Scrape type for WT92928: 1
2026-03-27 20:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT10085> (referer: https://www.auto1.com/v1/car-details-view/HT10085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_820af3291d3fa3a9f049d33df1cfa6fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_4779d7466dcd3a91460a1645cdc1f080.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_4779d7466dcd3a91460a1645cdc1f080.jpg not downloaded yet
2026-03-27 20:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e59850>
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_b2dabef4e89d7887222a27d49b2c1570.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b2dabef4e89d7887222a27d49b2c1570.jpg saved to cache
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e9e290>
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_e55a759e4cd0f8282a3ee39c55e6eb41.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_e55a759e4cd0f8282a3ee39c55e6eb41.jpg saved to cache
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_2857c57da3182ffd70d4026d748d1b15.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_f16bd8c328601b00b2ac4de6d0a70301.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_f16bd8c328601b00b2ac4de6d0a70301.jpg not downloaded yet
2026-03-27 20:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e9b0f7b5fb3c65a33b70890eede01ab1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e65910>
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_318e9f13e3e6776642d0b8feeb92e9ca.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_318e9f13e3e6776642d0b8feeb92e9ca.jpg saved to cache
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-27 20:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ffbcec-e498-5381-a1c2-87246a33d0b6 with scrape type 1
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 93ffbcec-e498-5381-a1c2-87246a33d0b6
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_5d538f946548fa703e18327a68a1d352.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_5d538f946548fa703e18327a68a1d352.jpg not downloaded yet
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032191d0>
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_820af3291d3fa3a9f049d33df1cfa6fc.jpg') HTTP/1.1" 204 0
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_820af3291d3fa3a9f049d33df1cfa6fc.jpg saved to cache
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_6a1cf475d36613b229f03a428acb700c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_6a1cf475d36613b229f03a428acb700c.jpg not downloaded yet
2026-03-27 20:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_f5ef32d99a7dbe8705e095cdf594d67d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f5ef32d99a7dbe8705e095cdf594d67d.jpg not downloaded yet
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_978eab22fe5de985ad96cd0bc1c64f1b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_5a5b7b03541fc1eb0c81a26646d59c9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_5a5b7b03541fc1eb0c81a26646d59c9d.jpg not downloaded yet
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903db2ed0>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_2857c57da3182ffd70d4026d748d1b15.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_2857c57da3182ffd70d4026d748d1b15.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_4779d7466dcd3a91460a1645cdc1f080.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_844b33e0712fccfe5ddc6833e51f5073.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_844b33e0712fccfe5ddc6833e51f5073.jpg not downloaded yet
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903285c10>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_e9b0f7b5fb3c65a33b70890eede01ab1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e9b0f7b5fb3c65a33b70890eede01ab1.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_0b499faaa5e44e2b8f4d6a2be85d2c8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0b499faaa5e44e2b8f4d6a2be85d2c8d.jpg not downloaded yet
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ccb750>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_978eab22fe5de985ad96cd0bc1c64f1b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_978eab22fe5de985ad96cd0bc1c64f1b.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_f30cef3986ccc5cc59889866f6ead444.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f30cef3986ccc5cc59889866f6ead444.jpg not downloaded yet
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_6a1cf475d36613b229f03a428acb700c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f5ef32d99a7dbe8705e095cdf594d67d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_0ce7e8260d1cd98b1b091174d3aadbd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0ce7e8260d1cd98b1b091174d3aadbd2.jpg not downloaded yet
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903050c50>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_4779d7466dcd3a91460a1645cdc1f080.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_4779d7466dcd3a91460a1645cdc1f080.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_52056b96dd79b89b0a2c96aed18d7f6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e3200890623275eba17337034b54d86c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_572f5fb8c761f463ae2cad555c83485c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_25fd0e4975ba040037ab1ed0088e87a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d4a9d0>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_6a1cf475d36613b229f03a428acb700c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_6a1cf475d36613b229f03a428acb700c.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032ea990>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_f5ef32d99a7dbe8705e095cdf594d67d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f5ef32d99a7dbe8705e095cdf594d67d.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93ffbcec-e498-5381-a1c2-87246a33d0b6
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f30cef3986ccc5cc59889866f6ead444.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0b499faaa5e44e2b8f4d6a2be85d2c8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0ce7e8260d1cd98b1b091174d3aadbd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_844b33e0712fccfe5ddc6833e51f5073.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323ca50>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_52056b96dd79b89b0a2c96aed18d7f6e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_52056b96dd79b89b0a2c96aed18d7f6e.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903390450>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_e3200890623275eba17337034b54d86c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e3200890623275eba17337034b54d86c.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033900d0>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_572f5fb8c761f463ae2cad555c83485c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_572f5fb8c761f463ae2cad555c83485c.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903199690>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_25fd0e4975ba040037ab1ed0088e87a8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_25fd0e4975ba040037ab1ed0088e87a8.jpg saved to cache
2026-03-27 20:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP59959> (referer: https://www.auto1.com/v1/car-details-view/CP59959/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT15018> (referer: https://www.auto1.com/v1/car-details-view/YT15018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM95515> (referer: https://www.auto1.com/v1/car-details-view/PM95515/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA32651> (referer: https://www.auto1.com/v1/car-details-view/VA32651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY96127> (referer: https://www.auto1.com/v1/car-details-view/DY96127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB11874> (referer: https://www.auto1.com/v1/car-details-view/XB11874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL31605> (referer: https://www.auto1.com/v1/car-details-view/XL31605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032b06d0>
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_f30cef3986ccc5cc59889866f6ead444.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f30cef3986ccc5cc59889866f6ead444.jpg saved to cache
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93ffbcec-e498-5381-a1c2-87246a33d0b6
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e09a10>
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_0b499faaa5e44e2b8f4d6a2be85d2c8d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0b499faaa5e44e2b8f4d6a2be85d2c8d.jpg saved to cache
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93ffbcec-e498-5381-a1c2-87246a33d0b6
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90312f2d0>
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_0ce7e8260d1cd98b1b091174d3aadbd2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0ce7e8260d1cd98b1b091174d3aadbd2.jpg saved to cache
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93ffbcec-e498-5381-a1c2-87246a33d0b6
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032b8c50>
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_844b33e0712fccfe5ddc6833e51f5073.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_844b33e0712fccfe5ddc6833e51f5073.jpg saved to cache
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93ffbcec-e498-5381-a1c2-87246a33d0b6
2026-03-27 20:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW52037> (referer: https://www.auto1.com/v1/car-details-view/UW52037/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ccc4de-4d4a-5de3-90d1-58d1bc5904ef with identifier: CP59959
2026-03-27 20:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ccc4de-4d4a-5de3-90d1-58d1bc5904ef with scrape type 1
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44ccc4de-4d4a-5de3-90d1-58d1bc5904ef
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_6c71dc7c4a2d0067f24e6768cf6a0094.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_6c71dc7c4a2d0067f24e6768cf6a0094.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_166dcb4f4a344d597c1114bcd3a645c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_166dcb4f4a344d597c1114bcd3a645c7.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_1cf45a589230093fc72c7406d49446aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_1cf45a589230093fc72c7406d49446aa.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_10f0e231912dc9fd1263f2000a7f6a5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_10f0e231912dc9fd1263f2000a7f6a5a.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_40de94d84c2fa78294566af0aee69e9e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_40de94d84c2fa78294566af0aee69e9e.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_e37568b6d9ee526a01ee28cd38776919.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_e37568b6d9ee526a01ee28cd38776919.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_2b18214f4c7bf88300c7ad935752a8a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_2b18214f4c7bf88300c7ad935752a8a6.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_4ba352d958eb8aa4d2192f36d70960a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_4ba352d958eb8aa4d2192f36d70960a9.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_ad08252de2aae5806a054fc181383f02.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_ad08252de2aae5806a054fc181383f02.jpg already downloaded
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F57%252Fcd57d3b8106c2384a0ca2a75902e9cad%252Fpa%252FCP59959_43ecd09572522189fa14aeca4feb0c1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_43ecd09572522189fa14aeca4feb0c1c.jpg already downloaded
2026-03-27 20:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44ccc4de-4d4a-5de3-90d1-58d1bc5904ef, identifier: CP59959
2026-03-27 20:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018
2026-03-27 20:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3674d2-323c-5322-835c-f4857ed685fd with scrape type 1
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_0db0903b5b884a460e3232c0f3b082b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_0db0903b5b884a460e3232c0f3b082b1.jpg not downloaded yet
2026-03-27 20:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a121853b-296e-5f95-b7c6-59ab4f0edac1 with identifier: PM95515
2026-03-27 20:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a121853b-296e-5f95-b7c6-59ab4f0edac1 with scrape type 1
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_16cab45edf558c6c9483ad9d29119c07.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_16cab45edf558c6c9483ad9d29119c07.jpg not downloaded yet
2026-03-27 20:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-27 20:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9f557a-eaef-5d49-8a8c-25c71a222914 with scrape type 1
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_ee2bccbdf7f2a5f770163a340b1f5030.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ee2bccbdf7f2a5f770163a340b1f5030.jpg not downloaded yet
2026-03-27 20:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-27 20:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with scrape type 1
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_718a2785dbfd86a3bc8fbd070fa0c3f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_718a2785dbfd86a3bc8fbd070fa0c3f6.jpg not downloaded yet
2026-03-27 20:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-27 20:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with scrape type 1
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_490b8cdbca286f6c76c1aa734bf4685e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_490b8cdbca286f6c76c1aa734bf4685e.jpg not downloaded yet
2026-03-27 20:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb5deff-d838-5520-bf5f-8ada71808014 with identifier: XL31605
2026-03-27 20:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb5deff-d838-5520-bf5f-8ada71808014 with scrape type 1
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fbb5deff-d838-5520-bf5f-8ada71808014
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_25e0c3f0292afd30e553763f2ac8c2ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_25e0c3f0292afd30e553763f2ac8c2ed.jpg not downloaded yet
2026-03-27 20:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44ccc4de-4d4a-5de3-90d1-58d1bc5904ef with identifier: CP59959
2026-03-27 20:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44ccc4de-4d4a-5de3-90d1-58d1bc5904ef with identifier: CP59959
2026-03-27 20:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44ccc4de-4d4a-5de3-90d1-58d1bc5904ef with identifier: CP59959 to the API
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CP59959>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:26Z',
 'fuel_type': 'diesel',
 'id': '44ccc4de-4d4a-5de3-90d1-58d1bc5904ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP59959',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 223105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_6c71dc7c4a2d0067f24e6768cf6a0094.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_166dcb4f4a344d597c1114bcd3a645c7.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_1cf45a589230093fc72c7406d49446aa.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_10f0e231912dc9fd1263f2000a7f6a5a.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_40de94d84c2fa78294566af0aee69e9e.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_e37568b6d9ee526a01ee28cd38776919.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_2b18214f4c7bf88300c7ad935752a8a6.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_4ba352d958eb8aa4d2192f36d70960a9.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_ad08252de2aae5806a054fc181383f02.jpg',
                'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_43ecd09572522189fa14aeca4feb0c1c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_6c71dc7c4a2d0067f24e6768cf6a0094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_166dcb4f4a344d597c1114bcd3a645c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_1cf45a589230093fc72c7406d49446aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_10f0e231912dc9fd1263f2000a7f6a5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_40de94d84c2fa78294566af0aee69e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_e37568b6d9ee526a01ee28cd38776919.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_2b18214f4c7bf88300c7ad935752a8a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_4ba352d958eb8aa4d2192f36d70960a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_ad08252de2aae5806a054fc181383f02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44ccc4de-4d4a-5de3-90d1-58d1bc5904ef/44ccc4de-4d4a-5de3-90d1-58d1bc5904ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/57/cd57d3b8106c2384a0ca2a75902e9cad/pa/CP59959_43ecd09572522189fa14aeca4feb0c1c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2014}
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP59959%27 HTTP/1.1" 200 None
2026-03-27 20:39:01 [auto1.be] INFO: Saving data for CP59959: {'created_time': 1774643941.976714, 'last_price_update_time': 1774643941.976726, 'auction_closing_time': 1774715306.0}
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP59959') HTTP/1.1" 204 0
2026-03-27 20:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_5a5b7b03541fc1eb0c81a26646d59c9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_2646b37ddc377d55403b01f888a58970.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bd484a0c5d7138b53eb826a6d7350b14.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_8555a2539937e098a76929c1face378b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_8555a2539937e098a76929c1face378b.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_6fc4948b1ecff5abc51854cce31b0889.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6fc4948b1ecff5abc51854cce31b0889.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_a498b91f61cc2945f16da97ab1b652c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_a498b91f61cc2945f16da97ab1b652c6.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_01ef65dd312ef254ca883a79027580c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_01ef65dd312ef254ca883a79027580c1.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_edac0cf6a22a991ab4d8fc72bae1a832.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_edac0cf6a22a991ab4d8fc72bae1a832.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_1d4a1f5b4ed4058ec17c6ad5fcb4ee82.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_1d4a1f5b4ed4058ec17c6ad5fcb4ee82.jpg not downloaded yet
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_5d538f946548fa703e18327a68a1d352.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_b73d9ba5fddb0337fd04a90faa276d73.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_f16bd8c328601b00b2ac4de6d0a70301.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-27 20:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 540272db-9b64-5856-bc7b-f4976cdce59c with scrape type 1
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_f1f72be3676a72edf6ffe9c2e2c2d733.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f1f72be3676a72edf6ffe9c2e2c2d733.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_547e9ce48700800ea32873abd894521a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_547e9ce48700800ea32873abd894521a.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_419cd7be37d3d864de5c921df649ddf8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_419cd7be37d3d864de5c921df649ddf8.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_cccc36a5d13cacb6b4c46b173bec4578.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_cccc36a5d13cacb6b4c46b173bec4578.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_c59e8d09871c8c5cabed5f13c92c5b1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c59e8d09871c8c5cabed5f13c92c5b1e.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_3bd38a6cbb7efc75e731a1a60e267c83.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_3bd38a6cbb7efc75e731a1a60e267c83.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_9420792ce0497fc4d6b6d1ac138f3a60.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_9420792ce0497fc4d6b6d1ac138f3a60.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_8022f4c65d5c8f5272380e34ee594f2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_8022f4c65d5c8f5272380e34ee594f2d.jpg not downloaded yet
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_39c54b07828369b8cc51def7183ba7b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_9304e0bb7e6428ecd889ed82d5e7602a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b6817fc7e9d8894f392fd82f7bbda09f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_beed074136abb74f03a0d6766bda406c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_beed074136abb74f03a0d6766bda406c.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_cd22f5ac49322955b93a93207262d3bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_cd22f5ac49322955b93a93207262d3bf.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_95161ae347f55e008b4b684547096060.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_95161ae347f55e008b4b684547096060.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_5fa1296f42e9d5c6b9386dd703a4f866.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_5fa1296f42e9d5c6b9386dd703a4f866.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_1984f764d648ff7ba1349a202e405988.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_1984f764d648ff7ba1349a202e405988.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_ffdfd6da6e021ed85fc3a05506beb129.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_ffdfd6da6e021ed85fc3a05506beb129.jpg not downloaded yet
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e08050>
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_5a5b7b03541fc1eb0c81a26646d59c9d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_5a5b7b03541fc1eb0c81a26646d59c9d.jpg saved to cache
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eff550>
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_2646b37ddc377d55403b01f888a58970.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_2646b37ddc377d55403b01f888a58970.jpg saved to cache
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c93e10>
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_bd484a0c5d7138b53eb826a6d7350b14.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bd484a0c5d7138b53eb826a6d7350b14.jpg saved to cache
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_a558ab70ad360e88f86977a896300cc8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_a558ab70ad360e88f86977a896300cc8.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_1869cd815266b1cc8f92fa533ba4d052.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_1869cd815266b1cc8f92fa533ba4d052.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_d557d070b096d5b8a2c935b62bc89166.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_d557d070b096d5b8a2c935b62bc89166.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_dc36315f22a148d6cb0be132bfce78ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_dc36315f22a148d6cb0be132bfce78ab.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_7e741643959348f456894c81a516d7d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_7e741643959348f456894c81a516d7d3.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_73b63672ffcb5fe901cc996eb7d67f74.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_73b63672ffcb5fe901cc996eb7d67f74.jpg not downloaded yet
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_267277c4fc4d9f20ad6bd27fd6706f77.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_267277c4fc4d9f20ad6bd27fd6706f77.jpg not downloaded yet
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_718a2785dbfd86a3bc8fbd070fa0c3f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_25e0c3f0292afd30e553763f2ac8c2ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_181ed88408ab0d6e82466b067278ad52.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_181ed88408ab0d6e82466b067278ad52.jpg not downloaded yet
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903100a50>
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F43%252F114322213a5eafb45130e58cd7ce3a5d%252Fpa%252FHT10085_5d538f946548fa703e18327a68a1d352.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_5d538f946548fa703e18327a68a1d352.jpg saved to cache
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93ffbcec-e498-5381-a1c2-87246a33d0b6
2026-03-27 20:39:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93ffbcec-e498-5381-a1c2-87246a33d0b6, skipping ID generation
2026-03-27 20:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ffbcec-e498-5381-a1c2-87246a33d0b6 with scrape type 1
2026-03-27 20:39:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93ffbcec-e498-5381-a1c2-87246a33d0b6 sending to next pipeline
2026-03-27 20:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93ffbcec-e498-5381-a1c2-87246a33d0b6, identifier: HT10085
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f8be90>
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_b73d9ba5fddb0337fd04a90faa276d73.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_b73d9ba5fddb0337fd04a90faa276d73.jpg saved to cache
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc3050>
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fbc%252Fa4bc23e887b018ba337795481fafa688%252Fpa%252FFE88671_f16bd8c328601b00b2ac4de6d0a70301.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_f16bd8c328601b00b2ac4de6d0a70301.jpg saved to cache
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45b57a36-f67c-58ea-80bb-01e854084220
2026-03-27 20:39:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45b57a36-f67c-58ea-80bb-01e854084220, skipping ID generation
2026-03-27 20:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b57a36-f67c-58ea-80bb-01e854084220 with scrape type 1
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45b57a36-f67c-58ea-80bb-01e854084220 sending to next pipeline
2026-03-27 20:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45b57a36-f67c-58ea-80bb-01e854084220, identifier: FE88671
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e67210>
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_39c54b07828369b8cc51def7183ba7b6.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_39c54b07828369b8cc51def7183ba7b6.jpg saved to cache
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903efea50>
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_9304e0bb7e6428ecd889ed82d5e7602a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_9304e0bb7e6428ecd889ed82d5e7602a.jpg saved to cache
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd11d0>
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23de3755b61c38ddbede32452a1669%252Fpa%252FDL17322_b6817fc7e9d8894f392fd82f7bbda09f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b6817fc7e9d8894f392fd82f7bbda09f.jpg saved to cache
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3
2026-03-27 20:39:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3, skipping ID generation
2026-03-27 20:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with scrape type 1
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 sending to next pipeline
2026-03-27 20:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3, identifier: DL17322
2026-03-27 20:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_612e073e650017e30856dc36f9c08a57.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_16cab45edf558c6c9483ad9d29119c07.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_0db0903b5b884a460e3232c0f3b082b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_ee025885c8de66e3c871f04f35ebb0e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_ee025885c8de66e3c871f04f35ebb0e5.jpg not downloaded yet
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_f143f6b6606a00e000d52c8586d2e457.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_f143f6b6606a00e000d52c8586d2e457.jpg not downloaded yet
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_8b16c9861ff3b14f5e208fd5247c6a6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_8b16c9861ff3b14f5e208fd5247c6a6a.jpg not downloaded yet
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_c4bb1793980e429d98991826b84aac41.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c4bb1793980e429d98991826b84aac41.jpg not downloaded yet
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_cdd50bb67615d4db1331bbd6b20831d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_cdd50bb67615d4db1331bbd6b20831d8.jpg not downloaded yet
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_d8f67dc0775ce6f508a099011eff7673.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_d8f67dc0775ce6f508a099011eff7673.jpg not downloaded yet
2026-03-27 20:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-27 20:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085
2026-03-27 20:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93ffbcec-e498-5381-a1c2-87246a33d0b6 with identifier: HT10085 to the API
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_5d538f946548fa703e18327a68a1d352.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:39:08Z',
 'fuel_type': 'petrol',
 'id': '93ffbcec-e498-5381-a1c2-87246a33d0b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT10085',
 'listing': 'auction',
 'location': 'BE, Lommel',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 207199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_5d538f946548fa703e18327a68a1d352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f5ef32d99a7dbe8705e095cdf594d67d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_844b33e0712fccfe5ddc6833e51f5073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0b499faaa5e44e2b8f4d6a2be85d2c8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_f30cef3986ccc5cc59889866f6ead444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ffbcec-e498-5381-a1c2-87246a33d0b6/93ffbcec-e498-5381-a1c2-87246a33d0b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/43/114322213a5eafb45130e58cd7ce3a5d/pa/HT10085_0ce7e8260d1cd98b1b091174d3aadbd2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-27 20:39:03 [auto1.be] INFO: Saving data for HT10085: {'created_time': 1774643943.914207, 'last_price_update_time': 1774643943.914219, 'auction_closing_time': 1774715948.0}
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT10085') HTTP/1.1" 204 0
2026-03-27 20:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-27 20:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671
2026-03-27 20:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45b57a36-f67c-58ea-80bb-01e854084220 with identifier: FE88671 to the API
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_f16bd8c328601b00b2ac4de6d0a70301.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:23:20Z',
 'fuel_type': 'hybrid',
 'id': '45b57a36-f67c-58ea-80bb-01e854084220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE88671',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 71172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_73be5490c3ec046410bfce3ca23d9a5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_e55a759e4cd0f8282a3ee39c55e6eb41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_820af3291d3fa3a9f049d33df1cfa6fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_b73d9ba5fddb0337fd04a90faa276d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_2646b37ddc377d55403b01f888a58970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_978eab22fe5de985ad96cd0bc1c64f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_4779d7466dcd3a91460a1645cdc1f080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_f16bd8c328601b00b2ac4de6d0a70301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_6a1cf475d36613b229f03a428acb700c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45b57a36-f67c-58ea-80bb-01e854084220/45b57a36-f67c-58ea-80bb-01e854084220_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/bc/a4bc23e887b018ba337795481fafa688/pa/FE88671_5a5b7b03541fc1eb0c81a26646d59c9d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [auto1.be] INFO: Saving data for FE88671: {'created_time': 1774643944.288816, 'last_price_update_time': 1774643944.288825, 'auction_closing_time': 1774715000.0}
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FE88671') HTTP/1.1" 204 0
2026-03-27 20:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-27 20:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322
2026-03-27 20:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94a97b9e-79f0-5685-9957-e63f6c4dc0c3 with identifier: DL17322 to the API
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b6817fc7e9d8894f392fd82f7bbda09f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:46:29Z',
 'fuel_type': 'petrol',
 'id': '94a97b9e-79f0-5685-9957-e63f6c4dc0c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL17322',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b6817fc7e9d8894f392fd82f7bbda09f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bd484a0c5d7138b53eb826a6d7350b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_0383ade72a954dfdbb4af1712cd1e61a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_677fa2288d2658cfaf4643d00f15ccc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_2857c57da3182ffd70d4026d748d1b15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_04653ec2f265c7b761e009c03f0ad48b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_bdaaf37558489cfc8809360ac7160b3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_318e9f13e3e6776642d0b8feeb92e9ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_eee9ea282b6cc01c1b06686aff0f8ce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a97b9e-79f0-5685-9957-e63f6c4dc0c3/94a97b9e-79f0-5685-9957-e63f6c4dc0c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23de3755b61c38ddbede32452a1669/pa/DL17322_b2dabef4e89d7887222a27d49b2c1570.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [auto1.be] INFO: Saving data for DL17322: {'created_time': 1774643944.604322, 'last_price_update_time': 1774643944.604332, 'auction_closing_time': 1774716389.0}
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL17322') HTTP/1.1" 204 0
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_9420792ce0497fc4d6b6d1ac138f3a60.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_b12c01e6d2f5bfe53fb78d6d04b8911e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_b12c01e6d2f5bfe53fb78d6d04b8911e.jpg not downloaded yet
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV08195/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_fa20854f466f28ed68b9bbb435345691.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_fa20854f466f28ed68b9bbb435345691.jpg not downloaded yet
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_52d373a5ce004f0202df9807f3d1d4d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_52d373a5ce004f0202df9807f3d1d4d8.jpg not downloaded yet
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_25846e895e7aa0c9255f20bab8f159bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_25846e895e7aa0c9255f20bab8f159bb.jpg not downloaded yet
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_35454b37efc9ee873408a3547800fe5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_35454b37efc9ee873408a3547800fe5f.jpg not downloaded yet
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT92928/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST31185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG62523> (referer: https://www.auto1.com/v1/car-details-view/YG62523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM57328> (referer: https://www.auto1.com/v1/car-details-view/AM57328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF96553> (referer: https://www.auto1.com/v1/car-details-view/VF96553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fa59d0>
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_718a2785dbfd86a3bc8fbd070fa0c3f6.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_718a2785dbfd86a3bc8fbd070fa0c3f6.jpg saved to cache
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031c1810>
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_25e0c3f0292afd30e553763f2ac8c2ed.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_25e0c3f0292afd30e553763f2ac8c2ed.jpg saved to cache
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbb5deff-d838-5520-bf5f-8ada71808014
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_3bd38a6cbb7efc75e731a1a60e267c83.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c59e8d09871c8c5cabed5f13c92c5b1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_4e92905f62e04f26ec58c36039255213.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_4e92905f62e04f26ec58c36039255213.jpg not downloaded yet
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_d107c228de69ed731f6c6afd00e7e3fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_d107c228de69ed731f6c6afd00e7e3fc.jpg not downloaded yet
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_6330980bfd8ec5e043455b12330f7141.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6330980bfd8ec5e043455b12330f7141.jpg not downloaded yet
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_fd0b49aba7fa8151dc5e96be7038958d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_fd0b49aba7fa8151dc5e96be7038958d.jpg not downloaded yet
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_ff718a9a0fdcbe57dc65f12b850bff19.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ff718a9a0fdcbe57dc65f12b850bff19.jpg not downloaded yet
2026-03-27 20:39:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90314d6d0>
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_612e073e650017e30856dc36f9c08a57.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_612e073e650017e30856dc36f9c08a57.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e56ed0>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_16cab45edf558c6c9483ad9d29119c07.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_16cab45edf558c6c9483ad9d29119c07.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9120fd8d0>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_0db0903b5b884a460e3232c0f3b082b1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_0db0903b5b884a460e3232c0f3b082b1.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_ffdfd6da6e021ed85fc3a05506beb129.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_a558ab70ad360e88f86977a896300cc8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_267277c4fc4d9f20ad6bd27fd6706f77.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_f7fe0cc96b3d74bd202bcdeadb1d3bc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f7fe0cc96b3d74bd202bcdeadb1d3bc2.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_85cd0d483ee9f5d82470e600919f2ae7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_85cd0d483ee9f5d82470e600919f2ae7.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_21bf797ad5a228707f46dce4026668be.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_21bf797ad5a228707f46dce4026668be.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_ade94194e877679678e64586a77ebf46.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ade94194e877679678e64586a77ebf46.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_ec86815b44bf9d1759b6602020cc03e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ec86815b44bf9d1759b6602020cc03e8.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_d69ad28f121114aba9f7dc00d34fdd9b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_d69ad28f121114aba9f7dc00d34fdd9b.jpg not downloaded yet
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90332b150>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_9420792ce0497fc4d6b6d1ac138f3a60.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_9420792ce0497fc4d6b6d1ac138f3a60.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbb5deff-d838-5520-bf5f-8ada71808014
2026-03-27 20:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-27 20:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 997495a0-4c1f-5553-943c-a995e47ef1b5 with scrape type 1
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 997495a0-4c1f-5553-943c-a995e47ef1b5
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_afd41e76203fea913f6d8cb0882bc7e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_afd41e76203fea913f6d8cb0882bc7e9.jpg not downloaded yet
2026-03-27 20:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 463bd444-dd00-5c3b-ae55-0e74bca000eb with identifier: AM57328
2026-03-27 20:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 463bd444-dd00-5c3b-ae55-0e74bca000eb with scrape type 1
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_06f02b66bde692638a38622bb5ec4a0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_06f02b66bde692638a38622bb5ec4a0f.jpg not downloaded yet
2026-03-27 20:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a06308f3-2f52-5b04-adb4-e7d12bf66fa9 with identifier: VF96553
2026-03-27 20:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9 with scrape type 1
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_5d5d5314ba0c32ba905547286f8b2d1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_5d5d5314ba0c32ba905547286f8b2d1f.jpg not downloaded yet
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d41150>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_3bd38a6cbb7efc75e731a1a60e267c83.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_3bd38a6cbb7efc75e731a1a60e267c83.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fcdc10>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_c59e8d09871c8c5cabed5f13c92c5b1e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c59e8d09871c8c5cabed5f13c92c5b1e.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_44a1622d7de1857dfb60930a18614d17.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_44a1622d7de1857dfb60930a18614d17.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_2dae3dcc56802b51f201e87364f28757.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_2dae3dcc56802b51f201e87364f28757.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_787625a2bd987cdaf6d1ac671e07421c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_787625a2bd987cdaf6d1ac671e07421c.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_75e6195c863b21303288cb7cc4c9288d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_75e6195c863b21303288cb7cc4c9288d.jpg not downloaded yet
2026-03-27 20:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_7e741643959348f456894c81a516d7d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_181ed88408ab0d6e82466b067278ad52.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_d8f67dc0775ce6f508a099011eff7673.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_57eaf8d83bd72c03f398229b67e3fc81.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_57eaf8d83bd72c03f398229b67e3fc81.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_385a79521a0716a4c99730263033fb7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_385a79521a0716a4c99730263033fb7a.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_223b2a5893fc3bc87cd81b38b385d357.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_223b2a5893fc3bc87cd81b38b385d357.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_e9d8f351f1e5a3c1ae6823fa53d962d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_e9d8f351f1e5a3c1ae6823fa53d962d7.jpg not downloaded yet
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e9fcd0>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_ffdfd6da6e021ed85fc3a05506beb129.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_ffdfd6da6e021ed85fc3a05506beb129.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbb5deff-d838-5520-bf5f-8ada71808014
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903049810>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_a558ab70ad360e88f86977a896300cc8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_a558ab70ad360e88f86977a896300cc8.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323e350>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_267277c4fc4d9f20ad6bd27fd6706f77.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_267277c4fc4d9f20ad6bd27fd6706f77.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbb5deff-d838-5520-bf5f-8ada71808014
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_5b3f847156ca63f6b33dc384b710c567.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_5b3f847156ca63f6b33dc384b710c567.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_bbcb5da7a116758b6aca915f7a84f33f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_bbcb5da7a116758b6aca915f7a84f33f.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_9ab68c16441a2cc1a90f36ba515c4fa2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_9ab68c16441a2cc1a90f36ba515c4fa2.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_bccf66be3f5bafafd8e5c6502d9e8354.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_bccf66be3f5bafafd8e5c6502d9e8354.jpg not downloaded yet
2026-03-27 20:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_52d373a5ce004f0202df9807f3d1d4d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_7c00c7307d85ecd418dec707fbb6d375.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_7c00c7307d85ecd418dec707fbb6d375.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_3990f6902510cbf44973d059308a8f94.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_3990f6902510cbf44973d059308a8f94.jpg not downloaded yet
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_1b5d58158e6cc7b94705d0f70328f5c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_1b5d58158e6cc7b94705d0f70328f5c5.jpg not downloaded yet
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe910d389d0>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_7e741643959348f456894c81a516d7d3.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_7e741643959348f456894c81a516d7d3.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ef9810>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_181ed88408ab0d6e82466b067278ad52.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_181ed88408ab0d6e82466b067278ad52.jpg saved to cache
2026-03-27 20:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90328b690>
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_d8f67dc0775ce6f508a099011eff7673.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_d8f67dc0775ce6f508a099011eff7673.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbb5deff-d838-5520-bf5f-8ada71808014
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_b12c01e6d2f5bfe53fb78d6d04b8911e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_6cd0d7f132ede5b1552ebe328fa00ac1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_6cd0d7f132ede5b1552ebe328fa00ac1.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_7f2863e3f93476b70ffeca5fa21bd40d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_7f2863e3f93476b70ffeca5fa21bd40d.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_9b7ad436c9f90209d1833d7dbd343e13.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_9b7ad436c9f90209d1833d7dbd343e13.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_feac9c6840c9c41124c3c7aa09866c62.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_feac9c6840c9c41124c3c7aa09866c62.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_c30b2fe93ae5b48864717449498cd2c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_c30b2fe93ae5b48864717449498cd2c6.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_db92195ae9acad060cede3501de2bfbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_db92195ae9acad060cede3501de2bfbe.jpg not downloaded yet
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_cdd50bb67615d4db1331bbd6b20831d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe910d11690>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_52d373a5ce004f0202df9807f3d1d4d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_52d373a5ce004f0202df9807f3d1d4d8.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_98370ab1fac1f32cdf52c99ff023ef11.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_98370ab1fac1f32cdf52c99ff023ef11.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_2c4c555f06f1eb444a9cb84548684a1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_2c4c555f06f1eb444a9cb84548684a1b.jpg not downloaded yet
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c4bb1793980e429d98991826b84aac41.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90321ca50>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_b12c01e6d2f5bfe53fb78d6d04b8911e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_b12c01e6d2f5bfe53fb78d6d04b8911e.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_dd938592d54fc069d02dcb413935587c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_dd938592d54fc069d02dcb413935587c.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_705970bd5514e40797f90b210efca7a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_705970bd5514e40797f90b210efca7a1.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_85b923ee21e438bd1767a0f8593066fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_85b923ee21e438bd1767a0f8593066fc.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_ed8111096ebcfa63a2aa773d1d093fef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_ed8111096ebcfa63a2aa773d1d093fef.jpg not downloaded yet
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ffff90>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_cdd50bb67615d4db1331bbd6b20831d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_cdd50bb67615d4db1331bbd6b20831d8.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_4e92905f62e04f26ec58c36039255213.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_b0cf7a53698b3c4c40a6165a2e482ef0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_b0cf7a53698b3c4c40a6165a2e482ef0.jpg not downloaded yet
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_a192e0dadbea92300c7bd7e2d7b3825f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_a192e0dadbea92300c7bd7e2d7b3825f.jpg not downloaded yet
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90306d950>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_c4bb1793980e429d98991826b84aac41.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c4bb1793980e429d98991826b84aac41.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_f143f6b6606a00e000d52c8586d2e457.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ee2bccbdf7f2a5f770163a340b1f5030.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f95150>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_4e92905f62e04f26ec58c36039255213.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_4e92905f62e04f26ec58c36039255213.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_490b8cdbca286f6c76c1aa734bf4685e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_25846e895e7aa0c9255f20bab8f159bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_fa20854f466f28ed68b9bbb435345691.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_35454b37efc9ee873408a3547800fe5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903336b10>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_f143f6b6606a00e000d52c8586d2e457.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_f143f6b6606a00e000d52c8586d2e457.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_9b7ad436c9f90209d1833d7dbd343e13.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_2dae3dcc56802b51f201e87364f28757.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_bccf66be3f5bafafd8e5c6502d9e8354.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce7f50>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_ee2bccbdf7f2a5f770163a340b1f5030.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ee2bccbdf7f2a5f770163a340b1f5030.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:06 [scrapy.extensions.logstats] INFO: Crawled 261 pages (at 93 pages/min), scraped 249 items (at 48 items/min)
2026-03-27 20:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 199MiB
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_73b63672ffcb5fe901cc996eb7d67f74.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_db92195ae9acad060cede3501de2bfbe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_ed8111096ebcfa63a2aa773d1d093fef.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903227a10>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_490b8cdbca286f6c76c1aa734bf4685e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_490b8cdbca286f6c76c1aa734bf4685e.jpg saved to cache
2026-03-27 20:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9c690>
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_25846e895e7aa0c9255f20bab8f159bb.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_25846e895e7aa0c9255f20bab8f159bb.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032c2090>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_fa20854f466f28ed68b9bbb435345691.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_fa20854f466f28ed68b9bbb435345691.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9fc90>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_35454b37efc9ee873408a3547800fe5f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_35454b37efc9ee873408a3547800fe5f.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6f210>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_9b7ad436c9f90209d1833d7dbd343e13.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_9b7ad436c9f90209d1833d7dbd343e13.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ec350>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_2dae3dcc56802b51f201e87364f28757.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_2dae3dcc56802b51f201e87364f28757.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ef750>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_bccf66be3f5bafafd8e5c6502d9e8354.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_bccf66be3f5bafafd8e5c6502d9e8354.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_85b923ee21e438bd1767a0f8593066fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_b0cf7a53698b3c4c40a6165a2e482ef0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_a192e0dadbea92300c7bd7e2d7b3825f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ec850>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_73b63672ffcb5fe901cc996eb7d67f74.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_73b63672ffcb5fe901cc996eb7d67f74.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90322ef90>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_db92195ae9acad060cede3501de2bfbe.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_db92195ae9acad060cede3501de2bfbe.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f0f50>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_ed8111096ebcfa63a2aa773d1d093fef.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_ed8111096ebcfa63a2aa773d1d093fef.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_2c4c555f06f1eb444a9cb84548684a1b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_98370ab1fac1f32cdf52c99ff023ef11.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_705970bd5514e40797f90b210efca7a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_dd938592d54fc069d02dcb413935587c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033d5dd0>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_85b923ee21e438bd1767a0f8593066fc.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_85b923ee21e438bd1767a0f8593066fc.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903008290>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_b0cf7a53698b3c4c40a6165a2e482ef0.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_b0cf7a53698b3c4c40a6165a2e482ef0.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d1a010>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_a192e0dadbea92300c7bd7e2d7b3825f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_a192e0dadbea92300c7bd7e2d7b3825f.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_feac9c6840c9c41124c3c7aa09866c62.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_6cd0d7f132ede5b1552ebe328fa00ac1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_c30b2fe93ae5b48864717449498cd2c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_7f2863e3f93476b70ffeca5fa21bd40d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903281810>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_2c4c555f06f1eb444a9cb84548684a1b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_2c4c555f06f1eb444a9cb84548684a1b.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c99690>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_98370ab1fac1f32cdf52c99ff023ef11.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_98370ab1fac1f32cdf52c99ff023ef11.jpg saved to cache
2026-03-27 20:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90300a7d0>
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_705970bd5514e40797f90b210efca7a1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_705970bd5514e40797f90b210efca7a1.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903257750>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_dd938592d54fc069d02dcb413935587c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_dd938592d54fc069d02dcb413935587c.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_3990f6902510cbf44973d059308a8f94.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903289dd0>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_feac9c6840c9c41124c3c7aa09866c62.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_feac9c6840c9c41124c3c7aa09866c62.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 997495a0-4c1f-5553-943c-a995e47ef1b5
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033d7fd0>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_6cd0d7f132ede5b1552ebe328fa00ac1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_6cd0d7f132ede5b1552ebe328fa00ac1.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 997495a0-4c1f-5553-943c-a995e47ef1b5
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9af50>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_c30b2fe93ae5b48864717449498cd2c6.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_c30b2fe93ae5b48864717449498cd2c6.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90321cd50>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_7f2863e3f93476b70ffeca5fa21bd40d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_7f2863e3f93476b70ffeca5fa21bd40d.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_8b16c9861ff3b14f5e208fd5247c6a6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_bbcb5da7a116758b6aca915f7a84f33f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_7c00c7307d85ecd418dec707fbb6d375.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_9ab68c16441a2cc1a90f36ba515c4fa2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_5b3f847156ca63f6b33dc384b710c567.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f95e50>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_3990f6902510cbf44973d059308a8f94.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_3990f6902510cbf44973d059308a8f94.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_385a79521a0716a4c99730263033fb7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_44a1622d7de1857dfb60930a18614d17.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_223b2a5893fc3bc87cd81b38b385d357.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_57eaf8d83bd72c03f398229b67e3fc81.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_1b5d58158e6cc7b94705d0f70328f5c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_75e6195c863b21303288cb7cc4c9288d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_787625a2bd987cdaf6d1ac671e07421c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d18310>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_8b16c9861ff3b14f5e208fd5247c6a6a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_8b16c9861ff3b14f5e208fd5247c6a6a.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_e9d8f351f1e5a3c1ae6823fa53d962d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_21bf797ad5a228707f46dce4026668be.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_06f02b66bde692638a38622bb5ec4a0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_5d5d5314ba0c32ba905547286f8b2d1f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_d69ad28f121114aba9f7dc00d34fdd9b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_afd41e76203fea913f6d8cb0882bc7e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e8410>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_bbcb5da7a116758b6aca915f7a84f33f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_bbcb5da7a116758b6aca915f7a84f33f.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 997495a0-4c1f-5553-943c-a995e47ef1b5
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cd2790>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_7c00c7307d85ecd418dec707fbb6d375.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_7c00c7307d85ecd418dec707fbb6d375.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 997495a0-4c1f-5553-943c-a995e47ef1b5
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce0f50>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_9ab68c16441a2cc1a90f36ba515c4fa2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_9ab68c16441a2cc1a90f36ba515c4fa2.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d41c10>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_5b3f847156ca63f6b33dc384b710c567.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_5b3f847156ca63f6b33dc384b710c567.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903229650>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_385a79521a0716a4c99730263033fb7a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_385a79521a0716a4c99730263033fb7a.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 997495a0-4c1f-5553-943c-a995e47ef1b5
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903298390>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_44a1622d7de1857dfb60930a18614d17.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_44a1622d7de1857dfb60930a18614d17.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cd08d0>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_223b2a5893fc3bc87cd81b38b385d357.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_223b2a5893fc3bc87cd81b38b385d357.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c929d0>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_57eaf8d83bd72c03f398229b67e3fc81.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_57eaf8d83bd72c03f398229b67e3fc81.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90322b710>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_1b5d58158e6cc7b94705d0f70328f5c5.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_1b5d58158e6cc7b94705d0f70328f5c5.jpg saved to cache
2026-03-27 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b6310>
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_75e6195c863b21303288cb7cc4c9288d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_75e6195c863b21303288cb7cc4c9288d.jpg saved to cache
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce0790>
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_787625a2bd987cdaf6d1ac671e07421c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_787625a2bd987cdaf6d1ac671e07421c.jpg saved to cache
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f7fe0cc96b3d74bd202bcdeadb1d3bc2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce5790>
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_e9d8f351f1e5a3c1ae6823fa53d962d7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_e9d8f351f1e5a3c1ae6823fa53d962d7.jpg saved to cache
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe910d11010>
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_21bf797ad5a228707f46dce4026668be.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_21bf797ad5a228707f46dce4026668be.jpg saved to cache
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903241350>
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b6ef8daa2e85cfc66e5c3e6240db45%252Fpa%252FAM57328_06f02b66bde692638a38622bb5ec4a0f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_06f02b66bde692638a38622bb5ec4a0f.jpg saved to cache
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 463bd444-dd00-5c3b-ae55-0e74bca000eb
2026-03-27 20:39:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 463bd444-dd00-5c3b-ae55-0e74bca000eb, skipping ID generation
2026-03-27 20:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 463bd444-dd00-5c3b-ae55-0e74bca000eb with scrape type 1
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 463bd444-dd00-5c3b-ae55-0e74bca000eb sending to next pipeline
2026-03-27 20:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 463bd444-dd00-5c3b-ae55-0e74bca000eb, identifier: AM57328
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f96290>
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0a%252Fe90a16f44abc87acdb625f9f4092e1b3%252Fpa%252FVF96553_5d5d5314ba0c32ba905547286f8b2d1f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_5d5d5314ba0c32ba905547286f8b2d1f.jpg saved to cache
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9
2026-03-27 20:39:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a06308f3-2f52-5b04-adb4-e7d12bf66fa9, skipping ID generation
2026-03-27 20:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9 with scrape type 1
2026-03-27 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a06308f3-2f52-5b04-adb4-e7d12bf66fa9 sending to next pipeline
2026-03-27 20:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a06308f3-2f52-5b04-adb4-e7d12bf66fa9, identifier: VF96553
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d072d0>
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_d69ad28f121114aba9f7dc00d34fdd9b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_d69ad28f121114aba9f7dc00d34fdd9b.jpg saved to cache
2026-03-27 20:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90304c4d0>
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F40%252F4d400b8e2e62d8a0bbfdd16df879d849%252Fpa%252FYG62523_afd41e76203fea913f6d8cb0882bc7e9.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_afd41e76203fea913f6d8cb0882bc7e9.jpg saved to cache
2026-03-27 20:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 997495a0-4c1f-5553-943c-a995e47ef1b5
2026-03-27 20:39:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 997495a0-4c1f-5553-943c-a995e47ef1b5, skipping ID generation
2026-03-27 20:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 997495a0-4c1f-5553-943c-a995e47ef1b5 with scrape type 1
2026-03-27 20:39:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 997495a0-4c1f-5553-943c-a995e47ef1b5 sending to next pipeline
2026-03-27 20:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 997495a0-4c1f-5553-943c-a995e47ef1b5, identifier: YG62523
2026-03-27 20:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 463bd444-dd00-5c3b-ae55-0e74bca000eb with identifier: AM57328
2026-03-27 20:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 463bd444-dd00-5c3b-ae55-0e74bca000eb with identifier: AM57328
2026-03-27 20:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 463bd444-dd00-5c3b-ae55-0e74bca000eb with identifier: AM57328 to the API
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_06f02b66bde692638a38622bb5ec4a0f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:54:07Z',
 'fuel_type': 'petrol',
 'id': '463bd444-dd00-5c3b-ae55-0e74bca000eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM57328',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 149029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_06f02b66bde692638a38622bb5ec4a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_223b2a5893fc3bc87cd81b38b385d357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_9ab68c16441a2cc1a90f36ba515c4fa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_3990f6902510cbf44973d059308a8f94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_7f2863e3f93476b70ffeca5fa21bd40d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_c30b2fe93ae5b48864717449498cd2c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_98370ab1fac1f32cdf52c99ff023ef11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_dd938592d54fc069d02dcb413935587c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_85b923ee21e438bd1767a0f8593066fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_463bd444-dd00-5c3b-ae55-0e74bca000eb/463bd444-dd00-5c3b-ae55-0e74bca000eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b6ef8daa2e85cfc66e5c3e6240db45/pa/AM57328_b0cf7a53698b3c4c40a6165a2e482ef0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM57328%27 HTTP/1.1" 200 None
2026-03-27 20:39:10 [auto1.be] INFO: Saving data for AM57328: {'created_time': 1774643950.507972, 'last_price_update_time': 1774643950.507989, 'auction_closing_time': 1774716847.0}
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM57328') HTTP/1.1" 204 0
2026-03-27 20:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a06308f3-2f52-5b04-adb4-e7d12bf66fa9 with identifier: VF96553
2026-03-27 20:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a06308f3-2f52-5b04-adb4-e7d12bf66fa9 with identifier: VF96553
2026-03-27 20:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a06308f3-2f52-5b04-adb4-e7d12bf66fa9 with identifier: VF96553 to the API
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_5d5d5314ba0c32ba905547286f8b2d1f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:32:49Z',
 'fuel_type': 'diesel',
 'id': 'a06308f3-2f52-5b04-adb4-e7d12bf66fa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF96553',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 76502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_5d5d5314ba0c32ba905547286f8b2d1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_e9d8f351f1e5a3c1ae6823fa53d962d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_bccf66be3f5bafafd8e5c6502d9e8354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_1b5d58158e6cc7b94705d0f70328f5c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_9b7ad436c9f90209d1833d7dbd343e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_db92195ae9acad060cede3501de2bfbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_2c4c555f06f1eb444a9cb84548684a1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_705970bd5514e40797f90b210efca7a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_ed8111096ebcfa63a2aa773d1d093fef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a06308f3-2f52-5b04-adb4-e7d12bf66fa9/a06308f3-2f52-5b04-adb4-e7d12bf66fa9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0a/e90a16f44abc87acdb625f9f4092e1b3/pa/VF96553_a192e0dadbea92300c7bd7e2d7b3825f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 330 L2H2 Premium Stop&Start',
 'transmission': 'manual',
 'trim': '330 L2H2 Premium Stop&Start',
 'year': 2019}
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF96553%27 HTTP/1.1" 200 None
2026-03-27 20:39:10 [auto1.be] INFO: Saving data for VF96553: {'created_time': 1774643950.830889, 'last_price_update_time': 1774643950.8309, 'auction_closing_time': 1774715569.0}
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VF96553') HTTP/1.1" 204 0
2026-03-27 20:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-27 20:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523
2026-03-27 20:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 997495a0-4c1f-5553-943c-a995e47ef1b5 with identifier: YG62523 to the API
2026-03-27 20:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_afd41e76203fea913f6d8cb0882bc7e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:44:41Z',
 'fuel_type': 'diesel',
 'id': '997495a0-4c1f-5553-943c-a995e47ef1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG62523',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 240968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_afd41e76203fea913f6d8cb0882bc7e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_385a79521a0716a4c99730263033fb7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_bbcb5da7a116758b6aca915f7a84f33f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_7c00c7307d85ecd418dec707fbb6d375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_6cd0d7f132ede5b1552ebe328fa00ac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_997495a0-4c1f-5553-943c-a995e47ef1b5/997495a0-4c1f-5553-943c-a995e47ef1b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/40/4d400b8e2e62d8a0bbfdd16df879d849/pa/YG62523_feac9c6840c9c41124c3c7aa09866c62.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2011}
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [auto1.be] INFO: Saving data for YG62523: {'created_time': 1774643951.171657, 'last_price_update_time': 1774643951.171669, 'auction_closing_time': 1774716281.0}
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG62523') HTTP/1.1" 204 0
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT92928> (referer: https://www.auto1.com/v1/car-details-view/WT92928/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV08195> (referer: https://www.auto1.com/v1/car-details-view/FV08195/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST31185> (referer: https://www.auto1.com/v1/car-details-view/ST31185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_ee025885c8de66e3c871f04f35ebb0e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6330980bfd8ec5e043455b12330f7141.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_d107c228de69ed731f6c6afd00e7e3fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d5f090>
2026-03-27 20:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_f7fe0cc96b3d74bd202bcdeadb1d3bc2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f7fe0cc96b3d74bd202bcdeadb1d3bc2.jpg saved to cache
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ade94194e877679678e64586a77ebf46.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ec86815b44bf9d1759b6602020cc03e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_fd0b49aba7fa8151dc5e96be7038958d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_85cd0d483ee9f5d82470e600919f2ae7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ff718a9a0fdcbe57dc65f12b850bff19.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc4780c-ac1b-59ac-800f-3a261e7f7d90 with identifier: WT92928
2026-03-27 20:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90 with scrape type 1
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_f93cf27d0442aca7ccae0479bd88f1f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f93cf27d0442aca7ccae0479bd88f1f0.jpg not downloaded yet
2026-03-27 20:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17a69809-e9d8-5cba-b295-1daac98ba6f9 with identifier: FV08195
2026-03-27 20:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17a69809-e9d8-5cba-b295-1daac98ba6f9 with scrape type 1
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17a69809-e9d8-5cba-b295-1daac98ba6f9
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_e2bc843225fd8918fc8d7b4fafb5f0b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_e2bc843225fd8918fc8d7b4fafb5f0b6.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_c90363a38ca041bc5e065ff272f4fd72.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_c90363a38ca041bc5e065ff272f4fd72.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_08fca3c22a2a0320517dd4398fea7dc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_08fca3c22a2a0320517dd4398fea7dc9.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_4b312cce2ee16f20295832e80f9bf283.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_4b312cce2ee16f20295832e80f9bf283.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_251b88d91b6a3b67375bba4cc5bb417f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_251b88d91b6a3b67375bba4cc5bb417f.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_5aa8660f983bc84f1489fb5c4892d84b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_5aa8660f983bc84f1489fb5c4892d84b.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_e7f77ea04941783dec5c1038911c89e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_e7f77ea04941783dec5c1038911c89e9.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_fdb4e8277defa6bb00604f8d83f983f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_fdb4e8277defa6bb00604f8d83f983f7.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_becca9a0f2719d089159492e9dbc3a3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_becca9a0f2719d089159492e9dbc3a3a.jpg already downloaded
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F11%252Fa8112ac80286c52345fe6dd6e16eb68f%252Fpa%252FFV08195_4820377f050d7edd01f33573024a054c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_4820377f050d7edd01f33573024a054c.jpg already downloaded
2026-03-27 20:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17a69809-e9d8-5cba-b295-1daac98ba6f9, identifier: FV08195
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_d557d070b096d5b8a2c935b62bc89166.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17a69809-e9d8-5cba-b295-1daac98ba6f9 with identifier: FV08195
2026-03-27 20:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17a69809-e9d8-5cba-b295-1daac98ba6f9 with identifier: FV08195
2026-03-27 20:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17a69809-e9d8-5cba-b295-1daac98ba6f9 with identifier: FV08195 to the API
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FV08195>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:35:01Z',
 'fuel_type': 'petrol',
 'id': '17a69809-e9d8-5cba-b295-1daac98ba6f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV08195',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 92150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_e2bc843225fd8918fc8d7b4fafb5f0b6.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_c90363a38ca041bc5e065ff272f4fd72.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_08fca3c22a2a0320517dd4398fea7dc9.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_4b312cce2ee16f20295832e80f9bf283.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_251b88d91b6a3b67375bba4cc5bb417f.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_5aa8660f983bc84f1489fb5c4892d84b.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_e7f77ea04941783dec5c1038911c89e9.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_fdb4e8277defa6bb00604f8d83f983f7.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_becca9a0f2719d089159492e9dbc3a3a.jpg',
                'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_4820377f050d7edd01f33573024a054c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_e2bc843225fd8918fc8d7b4fafb5f0b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_c90363a38ca041bc5e065ff272f4fd72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_08fca3c22a2a0320517dd4398fea7dc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_4b312cce2ee16f20295832e80f9bf283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_251b88d91b6a3b67375bba4cc5bb417f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_5aa8660f983bc84f1489fb5c4892d84b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_e7f77ea04941783dec5c1038911c89e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_fdb4e8277defa6bb00604f8d83f983f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_becca9a0f2719d089159492e9dbc3a3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17a69809-e9d8-5cba-b295-1daac98ba6f9/17a69809-e9d8-5cba-b295-1daac98ba6f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/11/a8112ac80286c52345fe6dd6e16eb68f/pa/FV08195_4820377f050d7edd01f33573024a054c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2018}
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV08195%27 HTTP/1.1" 200 None
2026-03-27 20:39:11 [auto1.be] INFO: Saving data for FV08195: {'created_time': 1774643951.971965, 'last_price_update_time': 1774643951.971975, 'auction_closing_time': 1774715701.0}
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV08195') HTTP/1.1" 204 0
2026-03-27 20:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_1869cd815266b1cc8f92fa533ba4d052.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_428561d9de85b0723e303974d8465e77.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_428561d9de85b0723e303974d8465e77.jpg not downloaded yet
2026-03-27 20:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcd17caf-86a5-57b3-8259-05926d015214 with identifier: ST31185
2026-03-27 20:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcd17caf-86a5-57b3-8259-05926d015214 with scrape type 1
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_52c80e006026c1bd1e942e3810f769ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_52c80e006026c1bd1e942e3810f769ee.jpg not downloaded yet
2026-03-27 20:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_1984f764d648ff7ba1349a202e405988.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_cd22f5ac49322955b93a93207262d3bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_5fa1296f42e9d5c6b9386dd703a4f866.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_cb2be670b9b85a041829d840d8a5be55.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_cb2be670b9b85a041829d840d8a5be55.jpg not downloaded yet
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_1ddb2db7c9409c3248631a9f4a5f3844.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_1ddb2db7c9409c3248631a9f4a5f3844.jpg not downloaded yet
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c852d0>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_ee025885c8de66e3c871f04f35ebb0e5.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_ee025885c8de66e3c871f04f35ebb0e5.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e0e50>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_6330980bfd8ec5e043455b12330f7141.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6330980bfd8ec5e043455b12330f7141.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903107c50>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_d107c228de69ed731f6c6afd00e7e3fc.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_d107c228de69ed731f6c6afd00e7e3fc.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e4c990>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_ade94194e877679678e64586a77ebf46.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ade94194e877679678e64586a77ebf46.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e27d0>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_ec86815b44bf9d1759b6602020cc03e8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ec86815b44bf9d1759b6602020cc03e8.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ceb550>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_fd0b49aba7fa8151dc5e96be7038958d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_fd0b49aba7fa8151dc5e96be7038958d.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f75d0>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_85cd0d483ee9f5d82470e600919f2ae7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_85cd0d483ee9f5d82470e600919f2ae7.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f7c10>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_ff718a9a0fdcbe57dc65f12b850bff19.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ff718a9a0fdcbe57dc65f12b850bff19.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903106710>
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_d557d070b096d5b8a2c935b62bc89166.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_d557d070b096d5b8a2c935b62bc89166.jpg saved to cache
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_43c151e91013d0187914fea8b7f5f0c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_43c151e91013d0187914fea8b7f5f0c7.jpg not downloaded yet
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_5c676020c167520eb515c7b63a82f9c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_5c676020c167520eb515c7b63a82f9c0.jpg not downloaded yet
2026-03-27 20:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_8022f4c65d5c8f5272380e34ee594f2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_547e9ce48700800ea32873abd894521a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_419cd7be37d3d864de5c921df649ddf8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_308655cce4ee3c8a1f5df0ad87ab001c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_308655cce4ee3c8a1f5df0ad87ab001c.jpg not downloaded yet
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_ba3d1661807eebbdecb4be53af2c0dec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_ba3d1661807eebbdecb4be53af2c0dec.jpg not downloaded yet
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903289750>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_1869cd815266b1cc8f92fa533ba4d052.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_1869cd815266b1cc8f92fa533ba4d052.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033b7010>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_1984f764d648ff7ba1349a202e405988.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_1984f764d648ff7ba1349a202e405988.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90304b990>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_cd22f5ac49322955b93a93207262d3bf.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_cd22f5ac49322955b93a93207262d3bf.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90304a8d0>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_5fa1296f42e9d5c6b9386dd703a4f866.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_5fa1296f42e9d5c6b9386dd703a4f866.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_f3de97e7489075928c3f653b0982f2a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f3de97e7489075928c3f653b0982f2a1.jpg not downloaded yet
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_0c5043e3fd76b4801b858f46b0a176be.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_0c5043e3fd76b4801b858f46b0a176be.jpg not downloaded yet
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912ee0dd0>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_8022f4c65d5c8f5272380e34ee594f2d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_8022f4c65d5c8f5272380e34ee594f2d.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903297610>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_547e9ce48700800ea32873abd894521a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_547e9ce48700800ea32873abd894521a.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033a63d0>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_419cd7be37d3d864de5c921df649ddf8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_419cd7be37d3d864de5c921df649ddf8.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_6b0f811ba89b2c81e94e08c13c9824ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_6b0f811ba89b2c81e94e08c13c9824ce.jpg not downloaded yet
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_cb2be670b9b85a041829d840d8a5be55.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_7bda30565f1d7e6c91b9e5235b904b6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_7bda30565f1d7e6c91b9e5235b904b6e.jpg not downloaded yet
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_43c151e91013d0187914fea8b7f5f0c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_569d5d8f0dcb5c3f5696b289219d00b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_569d5d8f0dcb5c3f5696b289219d00b8.jpg not downloaded yet
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_b6ab442239fef9940b27b7c50d7b6622.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_b6ab442239fef9940b27b7c50d7b6622.jpg not downloaded yet
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_c409e6f40d6c2b60d0962e8d1744a441.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_c409e6f40d6c2b60d0962e8d1744a441.jpg not downloaded yet
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_dc36315f22a148d6cb0be132bfce78ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_95161ae347f55e008b4b684547096060.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903274110>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_cb2be670b9b85a041829d840d8a5be55.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_cb2be670b9b85a041829d840d8a5be55.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_beed074136abb74f03a0d6766bda406c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90303f7d0>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_43c151e91013d0187914fea8b7f5f0c7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_43c151e91013d0187914fea8b7f5f0c7.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_cccc36a5d13cacb6b4c46b173bec4578.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_5c676020c167520eb515c7b63a82f9c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032743d0>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_dc36315f22a148d6cb0be132bfce78ab.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_dc36315f22a148d6cb0be132bfce78ab.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_1d4a1f5b4ed4058ec17c6ad5fcb4ee82.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032d8850>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_95161ae347f55e008b4b684547096060.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_95161ae347f55e008b4b684547096060.jpg saved to cache
2026-03-27 20:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f1f72be3676a72edf6ffe9c2e2c2d733.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f93cf27d0442aca7ccae0479bd88f1f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_428561d9de85b0723e303974d8465e77.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_edac0cf6a22a991ab4d8fc72bae1a832.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_01ef65dd312ef254ca883a79027580c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d04e10>
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_beed074136abb74f03a0d6766bda406c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_beed074136abb74f03a0d6766bda406c.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032d9e90>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_cccc36a5d13cacb6b4c46b173bec4578.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_cccc36a5d13cacb6b4c46b173bec4578.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdaed0>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_5c676020c167520eb515c7b63a82f9c0.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_5c676020c167520eb515c7b63a82f9c0.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903295e50>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F21%252F75210280ddbd04c0483997090c0e647e%252Fpa%252FXL31605_1d4a1f5b4ed4058ec17c6ad5fcb4ee82.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_1d4a1f5b4ed4058ec17c6ad5fcb4ee82.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbb5deff-d838-5520-bf5f-8ada71808014
2026-03-27 20:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbb5deff-d838-5520-bf5f-8ada71808014, skipping ID generation
2026-03-27 20:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb5deff-d838-5520-bf5f-8ada71808014 with scrape type 1
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbb5deff-d838-5520-bf5f-8ada71808014 sending to next pipeline
2026-03-27 20:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fbb5deff-d838-5520-bf5f-8ada71808014, identifier: XL31605
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe91faad590>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F42%252Fce423426e9046175ebca3ef0cd9b6e58%252Fpa%252FUW52037_f1f72be3676a72edf6ffe9c2e2c2d733.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f1f72be3676a72edf6ffe9c2e2c2d733.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 540272db-9b64-5856-bc7b-f4976cdce59c
2026-03-27 20:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 540272db-9b64-5856-bc7b-f4976cdce59c, skipping ID generation
2026-03-27 20:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 540272db-9b64-5856-bc7b-f4976cdce59c with scrape type 1
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 540272db-9b64-5856-bc7b-f4976cdce59c sending to next pipeline
2026-03-27 20:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 540272db-9b64-5856-bc7b-f4976cdce59c, identifier: UW52037
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90304bd10>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_f93cf27d0442aca7ccae0479bd88f1f0.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f93cf27d0442aca7ccae0479bd88f1f0.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903317890>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_428561d9de85b0723e303974d8465e77.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_428561d9de85b0723e303974d8465e77.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b2210>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fed%252Fe8ed63f44740f38ace3070593de6d214%252Fpa%252FXB11874_edac0cf6a22a991ab4d8fc72bae1a832.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_edac0cf6a22a991ab4d8fc72bae1a832.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8
2026-03-27 20:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99415bc3-21eb-5b1a-940a-2c85acecd4e8, skipping ID generation
2026-03-27 20:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with scrape type 1
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99415bc3-21eb-5b1a-940a-2c85acecd4e8 sending to next pipeline
2026-03-27 20:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99415bc3-21eb-5b1a-940a-2c85acecd4e8, identifier: XB11874
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9121e1690>
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F1e%252F8e1e9b29c20eede43c6a4e290c5fc77f%252Fpa%252FDY96127_01ef65dd312ef254ca883a79027580c1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_01ef65dd312ef254ca883a79027580c1.jpg saved to cache
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e
2026-03-27 20:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e, skipping ID generation
2026-03-27 20:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with scrape type 1
2026-03-27 20:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0ab4ea5-3f2b-5460-bfa1-5d501721e97e sending to next pipeline
2026-03-27 20:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e, identifier: DY96127
2026-03-27 20:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fbb5deff-d838-5520-bf5f-8ada71808014 with identifier: XL31605
2026-03-27 20:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fbb5deff-d838-5520-bf5f-8ada71808014 with identifier: XL31605
2026-03-27 20:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fbb5deff-d838-5520-bf5f-8ada71808014 with identifier: XL31605 to the API
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_1d4a1f5b4ed4058ec17c6ad5fcb4ee82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:49:17Z',
 'fuel_type': 'petrol',
 'id': 'fbb5deff-d838-5520-bf5f-8ada71808014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL31605',
 'listing': 'auction',
 'location': 'BE, Aarschot',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 175363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_25e0c3f0292afd30e553763f2ac8c2ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_1d4a1f5b4ed4058ec17c6ad5fcb4ee82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_9420792ce0497fc4d6b6d1ac138f3a60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_ffdfd6da6e021ed85fc3a05506beb129.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_267277c4fc4d9f20ad6bd27fd6706f77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb5deff-d838-5520-bf5f-8ada71808014/fbb5deff-d838-5520-bf5f-8ada71808014_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/21/75210280ddbd04c0483997090c0e647e/pa/XL31605_d8f67dc0775ce6f508a099011eff7673.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL31605%27 HTTP/1.1" 200 None
2026-03-27 20:39:15 [auto1.be] INFO: Saving data for XL31605: {'created_time': 1774643955.344957, 'last_price_update_time': 1774643955.344967, 'auction_closing_time': 1774716557.0}
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL31605') HTTP/1.1" 204 0
2026-03-27 20:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-27 20:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037
2026-03-27 20:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 540272db-9b64-5856-bc7b-f4976cdce59c with identifier: UW52037 to the API
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f1f72be3676a72edf6ffe9c2e2c2d733.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:08Z',
 'fuel_type': 'diesel',
 'id': '540272db-9b64-5856-bc7b-f4976cdce59c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW52037',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 199524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f1f72be3676a72edf6ffe9c2e2c2d733.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_8022f4c65d5c8f5272380e34ee594f2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_a558ab70ad360e88f86977a896300cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_181ed88408ab0d6e82466b067278ad52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_b12c01e6d2f5bfe53fb78d6d04b8911e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_4e92905f62e04f26ec58c36039255213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_f7fe0cc96b3d74bd202bcdeadb1d3bc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_d69ad28f121114aba9f7dc00d34fdd9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_57eaf8d83bd72c03f398229b67e3fc81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_540272db-9b64-5856-bc7b-f4976cdce59c/540272db-9b64-5856-bc7b-f4976cdce59c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/42/ce423426e9046175ebca3ef0cd9b6e58/pa/UW52037_5b3f847156ca63f6b33dc384b710c567.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D3 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2020}
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-27 20:39:15 [auto1.be] INFO: Saving data for UW52037: {'created_time': 1774643955.692586, 'last_price_update_time': 1774643955.692596, 'auction_closing_time': 1774715528.0}
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW52037') HTTP/1.1" 204 0
2026-03-27 20:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-27 20:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874
2026-03-27 20:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99415bc3-21eb-5b1a-940a-2c85acecd4e8 with identifier: XB11874 to the API
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_edac0cf6a22a991ab4d8fc72bae1a832.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:10:20Z',
 'fuel_type': 'diesel',
 'id': '99415bc3-21eb-5b1a-940a-2c85acecd4e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB11874',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 59945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_490b8cdbca286f6c76c1aa734bf4685e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_edac0cf6a22a991ab4d8fc72bae1a832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_3bd38a6cbb7efc75e731a1a60e267c83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_1984f764d648ff7ba1349a202e405988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675237,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_73b63672ffcb5fe901cc996eb7d67f74.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_cdd50bb67615d4db1331bbd6b20831d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715729,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_35454b37efc9ee873408a3547800fe5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ff718a9a0fdcbe57dc65f12b850bff19.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_ec86815b44bf9d1759b6602020cc03e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99415bc3-21eb-5b1a-940a-2c85acecd4e8/99415bc3-21eb-5b1a-940a-2c85acecd4e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3177709,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ed/e8ed63f44740f38ace3070593de6d214/pa/XB11874_75e6195c863b21303288cb7cc4c9288d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-27 20:39:16 [auto1.be] INFO: Saving data for XB11874: {'created_time': 1774643956.570489, 'last_price_update_time': 1774643956.570499, 'auction_closing_time': 1774714220.0}
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB11874') HTTP/1.1" 204 0
2026-03-27 20:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-27 20:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127
2026-03-27 20:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0ab4ea5-3f2b-5460-bfa1-5d501721e97e with identifier: DY96127 to the API
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_01ef65dd312ef254ca883a79027580c1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:39:09Z',
 'fuel_type': 'petrol',
 'id': 'f0ab4ea5-3f2b-5460-bfa1-5d501721e97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY96127',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 265005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_718a2785dbfd86a3bc8fbd070fa0c3f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_01ef65dd312ef254ca883a79027580c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c59e8d09871c8c5cabed5f13c92c5b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_5fa1296f42e9d5c6b9386dd703a4f866.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_7e741643959348f456894c81a516d7d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ab4ea5-3f2b-5460-bfa1-5d501721e97e/f0ab4ea5-3f2b-5460-bfa1-5d501721e97e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/1e/8e1e9b29c20eede43c6a4e290c5fc77f/pa/DY96127_c4bb1793980e429d98991826b84aac41.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-27 20:39:16 [auto1.be] INFO: Saving data for DY96127: {'created_time': 1774643956.898777, 'last_price_update_time': 1774643956.898787, 'auction_closing_time': 1774715949.0}
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY96127') HTTP/1.1" 204 0
2026-03-27 20:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_1ddb2db7c9409c3248631a9f4a5f3844.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_52c80e006026c1bd1e942e3810f769ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_a498b91f61cc2945f16da97ab1b652c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_c409e6f40d6c2b60d0962e8d1744a441.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_7bda30565f1d7e6c91b9e5235b904b6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_b6ab442239fef9940b27b7c50d7b6622.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_6b0f811ba89b2c81e94e08c13c9824ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_8555a2539937e098a76929c1face378b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6fc4948b1ecff5abc51854cce31b0889.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f3de97e7489075928c3f653b0982f2a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903207710>
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_1ddb2db7c9409c3248631a9f4a5f3844.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_1ddb2db7c9409c3248631a9f4a5f3844.jpg saved to cache
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_59317ee5502a373878fc19cb825b6999.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ef8a50>
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_52c80e006026c1bd1e942e3810f769ee.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_52c80e006026c1bd1e942e3810f769ee.jpg saved to cache
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c5d4d0>
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F0f%252Fd50f536795b4888e4ffef98bd7b5f509%252Fpa%252FVA32651_a498b91f61cc2945f16da97ab1b652c6.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_a498b91f61cc2945f16da97ab1b652c6.jpg saved to cache
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f9f557a-eaef-5d49-8a8c-25c71a222914
2026-03-27 20:39:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f9f557a-eaef-5d49-8a8c-25c71a222914, skipping ID generation
2026-03-27 20:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9f557a-eaef-5d49-8a8c-25c71a222914 with scrape type 1
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f9f557a-eaef-5d49-8a8c-25c71a222914 sending to next pipeline
2026-03-27 20:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f9f557a-eaef-5d49-8a8c-25c71a222914, identifier: VA32651
2026-03-27 20:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c68910>
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_c409e6f40d6c2b60d0962e8d1744a441.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_c409e6f40d6c2b60d0962e8d1744a441.jpg saved to cache
2026-03-27 20:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903104110>
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_7bda30565f1d7e6c91b9e5235b904b6e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_7bda30565f1d7e6c91b9e5235b904b6e.jpg saved to cache
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce0250>
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_b6ab442239fef9940b27b7c50d7b6622.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_b6ab442239fef9940b27b7c50d7b6622.jpg saved to cache
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd21d0>
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_6b0f811ba89b2c81e94e08c13c9824ce.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_6b0f811ba89b2c81e94e08c13c9824ce.jpg saved to cache
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eee250>
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F7d%252Fc37d0021f8a25145a585695e46f59bfd%252Fpa%252FYT15018_8555a2539937e098a76929c1face378b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_8555a2539937e098a76929c1face378b.jpg saved to cache
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac3674d2-323c-5322-835c-f4857ed685fd
2026-03-27 20:39:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac3674d2-323c-5322-835c-f4857ed685fd, skipping ID generation
2026-03-27 20:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3674d2-323c-5322-835c-f4857ed685fd with scrape type 1
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac3674d2-323c-5322-835c-f4857ed685fd sending to next pipeline
2026-03-27 20:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac3674d2-323c-5322-835c-f4857ed685fd, identifier: YT15018
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c682d0>
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F78%252F5678d435e6cf6ee83b11076f3138d8c0%252Fpa%252FPM95515_6fc4948b1ecff5abc51854cce31b0889.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6fc4948b1ecff5abc51854cce31b0889.jpg saved to cache
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a121853b-296e-5f95-b7c6-59ab4f0edac1
2026-03-27 20:39:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a121853b-296e-5f95-b7c6-59ab4f0edac1, skipping ID generation
2026-03-27 20:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a121853b-296e-5f95-b7c6-59ab4f0edac1 with scrape type 1
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a121853b-296e-5f95-b7c6-59ab4f0edac1 sending to next pipeline
2026-03-27 20:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a121853b-296e-5f95-b7c6-59ab4f0edac1, identifier: PM95515
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c5f010>
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_f3de97e7489075928c3f653b0982f2a1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f3de97e7489075928c3f653b0982f2a1.jpg saved to cache
2026-03-27 20:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90
2026-03-27 20:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_308655cce4ee3c8a1f5df0ad87ab001c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-27 20:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651
2026-03-27 20:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f9f557a-eaef-5d49-8a8c-25c71a222914 with identifier: VA32651 to the API
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_a498b91f61cc2945f16da97ab1b652c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:04:17Z',
 'fuel_type': 'petrol',
 'id': '9f9f557a-eaef-5d49-8a8c-25c71a222914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA32651',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 202806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2232383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ee2bccbdf7f2a5f770163a340b1f5030.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2358933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_a498b91f61cc2945f16da97ab1b652c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2390045,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_cccc36a5d13cacb6b4c46b173bec4578.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2270415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_95161ae347f55e008b4b684547096060.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2306599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_dc36315f22a148d6cb0be132bfce78ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2333267,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_8b16c9861ff3b14f5e208fd5247c6a6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2284886,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_25846e895e7aa0c9255f20bab8f159bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2346313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_fd0b49aba7fa8151dc5e96be7038958d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_ade94194e877679678e64586a77ebf46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f9f557a-eaef-5d49-8a8c-25c71a222914/9f9f557a-eaef-5d49-8a8c-25c71a222914_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/0f/d50f536795b4888e4ffef98bd7b5f509/pa/VA32651_787625a2bd987cdaf6d1ac671e07421c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2015}
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-27 20:39:18 [auto1.be] INFO: Saving data for VA32651: {'created_time': 1774643958.862555, 'last_price_update_time': 1774643958.862567, 'auction_closing_time': 1774713857.0}
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA32651') HTTP/1.1" 204 0
2026-03-27 20:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018
2026-03-27 20:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018
2026-03-27 20:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac3674d2-323c-5322-835c-f4857ed685fd with identifier: YT15018 to the API
2026-03-27 20:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_8555a2539937e098a76929c1face378b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:22:50Z',
 'fuel_type': 'petrol',
 'id': 'ac3674d2-323c-5322-835c-f4857ed685fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT15018',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 74129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_0db0903b5b884a460e3232c0f3b082b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_8555a2539937e098a76929c1face378b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_547e9ce48700800ea32873abd894521a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2454155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_beed074136abb74f03a0d6766bda406c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_1869cd815266b1cc8f92fa533ba4d052.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_ee025885c8de66e3c871f04f35ebb0e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2214445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_fa20854f466f28ed68b9bbb435345691.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_d107c228de69ed731f6c6afd00e7e3fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_85cd0d483ee9f5d82470e600919f2ae7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3674d2-323c-5322-835c-f4857ed685fd/ac3674d2-323c-5322-835c-f4857ed685fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/7d/c37d0021f8a25145a585695e46f59bfd/pa/YT15018_44a1622d7de1857dfb60930a18614d17.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-27 20:39:19 [auto1.be] INFO: Saving data for YT15018: {'created_time': 1774643959.209598, 'last_price_update_time': 1774643959.209608, 'auction_closing_time': 1774714970.0}
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YT15018') HTTP/1.1" 204 0
2026-03-27 20:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a121853b-296e-5f95-b7c6-59ab4f0edac1 with identifier: PM95515
2026-03-27 20:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a121853b-296e-5f95-b7c6-59ab4f0edac1 with identifier: PM95515
2026-03-27 20:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a121853b-296e-5f95-b7c6-59ab4f0edac1 with identifier: PM95515 to the API
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6fc4948b1ecff5abc51854cce31b0889.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:33Z',
 'fuel_type': 'petrol',
 'id': 'a121853b-296e-5f95-b7c6-59ab4f0edac1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM95515',
 'listing': 'auction',
 'location': 'BE',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 267933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_16cab45edf558c6c9483ad9d29119c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6fc4948b1ecff5abc51854cce31b0889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_419cd7be37d3d864de5c921df649ddf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_cd22f5ac49322955b93a93207262d3bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_d557d070b096d5b8a2c935b62bc89166.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_f143f6b6606a00e000d52c8586d2e457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_52d373a5ce004f0202df9807f3d1d4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_6330980bfd8ec5e043455b12330f7141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_21bf797ad5a228707f46dce4026668be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a121853b-296e-5f95-b7c6-59ab4f0edac1/a121853b-296e-5f95-b7c6-59ab4f0edac1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/78/5678d435e6cf6ee83b11076f3138d8c0/pa/PM95515_2dae3dcc56802b51f201e87364f28757.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-07-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 2.0i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM95515%27 HTTP/1.1" 200 None
2026-03-27 20:39:19 [auto1.be] INFO: Saving data for PM95515: {'created_time': 1774643959.528557, 'last_price_update_time': 1774643959.528568, 'auction_closing_time': 1774715073.0}
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM95515') HTTP/1.1" 204 0
2026-03-27 20:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_569d5d8f0dcb5c3f5696b289219d00b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ48466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903172290>
2026-03-27 20:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fb1%252F93b1009628dc58550bb3966602a845cd%252Fpa%252FWJ85942_59317ee5502a373878fc19cb825b6999.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_59317ee5502a373878fc19cb825b6999.jpg saved to cache
2026-03-27 20:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a29a99ba-c57d-5253-ae98-692c57ecd3b3
2026-03-27 20:39:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a29a99ba-c57d-5253-ae98-692c57ecd3b3, skipping ID generation
2026-03-27 20:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29a99ba-c57d-5253-ae98-692c57ecd3b3 with scrape type 1
2026-03-27 20:39:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a29a99ba-c57d-5253-ae98-692c57ecd3b3 sending to next pipeline
2026-03-27 20:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a29a99ba-c57d-5253-ae98-692c57ecd3b3, identifier: WJ85942
2026-03-27 20:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-27 20:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942
2026-03-27 20:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a29a99ba-c57d-5253-ae98-692c57ecd3b3 with identifier: WJ85942 to the API
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_59317ee5502a373878fc19cb825b6999.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:56:05Z',
 'fuel_type': 'diesel',
 'id': 'a29a99ba-c57d-5253-ae98-692c57ecd3b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ85942',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 82952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_59317ee5502a373878fc19cb825b6999.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_612e073e650017e30856dc36f9c08a57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269388,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_9304e0bb7e6428ecd889ed82d5e7602a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2155756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_52056b96dd79b89b0a2c96aed18d7f6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295419,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_c8041aa0d193478f39d82b30a0ae84e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295198,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_39c54b07828369b8cc51def7183ba7b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e3200890623275eba17337034b54d86c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_572f5fb8c761f463ae2cad555c83485c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335401,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_e9b0f7b5fb3c65a33b70890eede01ab1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29a99ba-c57d-5253-ae98-692c57ecd3b3/a29a99ba-c57d-5253-ae98-692c57ecd3b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/b1/93b1009628dc58550bb3966602a845cd/pa/WJ85942_25fd0e4975ba040037ab1ed0088e87a8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L1 Premium',
 'transmission': 'manual',
 'trim': 'L1 Premium',
 'year': 2018}
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-27 20:39:20 [auto1.be] INFO: Saving data for WJ85942: {'created_time': 1774643960.031396, 'last_price_update_time': 1774643960.031407, 'auction_closing_time': 1774716965.0}
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ85942') HTTP/1.1" 204 0
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033b6cd0>
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F1b%252Fc01be9f8225d289fc39b857cc7293f65%252Fpa%252FWT92928_308655cce4ee3c8a1f5df0ad87ab001c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_308655cce4ee3c8a1f5df0ad87ab001c.jpg saved to cache
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90
2026-03-27 20:39:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bc4780c-ac1b-59ac-800f-3a261e7f7d90, skipping ID generation
2026-03-27 20:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90 with scrape type 1
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bc4780c-ac1b-59ac-800f-3a261e7f7d90 sending to next pipeline
2026-03-27 20:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3bc4780c-ac1b-59ac-800f-3a261e7f7d90, identifier: WT92928
2026-03-27 20:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3bc4780c-ac1b-59ac-800f-3a261e7f7d90 with identifier: WT92928
2026-03-27 20:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3bc4780c-ac1b-59ac-800f-3a261e7f7d90 with identifier: WT92928
2026-03-27 20:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3bc4780c-ac1b-59ac-800f-3a261e7f7d90 with identifier: WT92928 to the API
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_308655cce4ee3c8a1f5df0ad87ab001c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:43:29Z',
 'fuel_type': 'diesel',
 'id': '3bc4780c-ac1b-59ac-800f-3a261e7f7d90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT92928',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 127563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f93cf27d0442aca7ccae0479bd88f1f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_428561d9de85b0723e303974d8465e77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_cb2be670b9b85a041829d840d8a5be55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_43c151e91013d0187914fea8b7f5f0c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_308655cce4ee3c8a1f5df0ad87ab001c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bc4780c-ac1b-59ac-800f-3a261e7f7d90/3bc4780c-ac1b-59ac-800f-3a261e7f7d90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/1b/c01be9f8225d289fc39b857cc7293f65/pa/WT92928_f3de97e7489075928c3f653b0982f2a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2010}
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT92928%27 HTTP/1.1" 200 None
2026-03-27 20:39:20 [auto1.be] INFO: Saving data for WT92928: {'created_time': 1774643960.511825, 'last_price_update_time': 1774643960.511835, 'auction_closing_time': 1774716209.0}
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT92928') HTTP/1.1" 204 0
2026-03-27 20:39:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912115dd0>
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_569d5d8f0dcb5c3f5696b289219d00b8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_569d5d8f0dcb5c3f5696b289219d00b8.jpg saved to cache
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR55859> (referer: https://www.auto1.com/v1/car-details-view/TR55859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_12d39436dd519d98970a6ab0addfe254.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_ba3d1661807eebbdecb4be53af2c0dec.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_0c5043e3fd76b4801b858f46b0a176be.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_b362db973239d72eecb3085493760be3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_1c66f7bb563c8634bb68f81a2cafdded.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7a89edd3f3d2956678519104bfc82309.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 990d78d7-5d5a-5d10-b077-858e767abc16 with identifier: TR55859
2026-03-27 20:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990d78d7-5d5a-5d10-b077-858e767abc16 with scrape type 1
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_f65f16da8797ffc296d1cb52e9b522fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_f65f16da8797ffc296d1cb52e9b522fb.jpg not downloaded yet
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_0c5893374db1b8e7a860a851e17d2d07.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_0c5893374db1b8e7a860a851e17d2d07.jpg not downloaded yet
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_08d33287345aeab89cac3a6aa4e3eaa9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_08d33287345aeab89cac3a6aa4e3eaa9.jpg not downloaded yet
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903065250>
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_12d39436dd519d98970a6ab0addfe254.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_12d39436dd519d98970a6ab0addfe254.jpg saved to cache
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb53b1f5-1571-55c4-a204-54bb00ae9e30
2026-03-27 20:39:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903240590>
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_ba3d1661807eebbdecb4be53af2c0dec.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_ba3d1661807eebbdecb4be53af2c0dec.jpg saved to cache
2026-03-27 20:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903198090>
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fc1%252F63c1db3f66f39cb73b6a77a8604e1aee%252Fpa%252FST31185_0c5043e3fd76b4801b858f46b0a176be.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_0c5043e3fd76b4801b858f46b0a176be.jpg saved to cache
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcd17caf-86a5-57b3-8259-05926d015214
2026-03-27 20:39:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcd17caf-86a5-57b3-8259-05926d015214, skipping ID generation
2026-03-27 20:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcd17caf-86a5-57b3-8259-05926d015214 with scrape type 1
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcd17caf-86a5-57b3-8259-05926d015214 sending to next pipeline
2026-03-27 20:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bcd17caf-86a5-57b3-8259-05926d015214, identifier: ST31185
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903eafe50>
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F00%252Fd5006ac42af76f679ee43b19a4864387%252Fpa%252FHY09771_b362db973239d72eecb3085493760be3.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_b362db973239d72eecb3085493760be3.jpg saved to cache
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb53b1f5-1571-55c4-a204-54bb00ae9e30
2026-03-27 20:39:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb53b1f5-1571-55c4-a204-54bb00ae9e30, skipping ID generation
2026-03-27 20:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb53b1f5-1571-55c4-a204-54bb00ae9e30 with scrape type 1
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb53b1f5-1571-55c4-a204-54bb00ae9e30 sending to next pipeline
2026-03-27 20:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb53b1f5-1571-55c4-a204-54bb00ae9e30, identifier: HY09771
2026-03-27 20:39:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031355d0>
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_1c66f7bb563c8634bb68f81a2cafdded.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_1c66f7bb563c8634bb68f81a2cafdded.jpg saved to cache
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bcd17caf-86a5-57b3-8259-05926d015214 with identifier: ST31185
2026-03-27 20:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bcd17caf-86a5-57b3-8259-05926d015214 with identifier: ST31185
2026-03-27 20:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bcd17caf-86a5-57b3-8259-05926d015214 with identifier: ST31185 to the API
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_0c5043e3fd76b4801b858f46b0a176be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:29:50Z',
 'fuel_type': 'petrol',
 'id': 'bcd17caf-86a5-57b3-8259-05926d015214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST31185',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 40572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_52c80e006026c1bd1e942e3810f769ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_1ddb2db7c9409c3248631a9f4a5f3844.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_5c676020c167520eb515c7b63a82f9c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_ba3d1661807eebbdecb4be53af2c0dec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_0c5043e3fd76b4801b858f46b0a176be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_6b0f811ba89b2c81e94e08c13c9824ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2448506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_7bda30565f1d7e6c91b9e5235b904b6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_569d5d8f0dcb5c3f5696b289219d00b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_b6ab442239fef9940b27b7c50d7b6622.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcd17caf-86a5-57b3-8259-05926d015214/bcd17caf-86a5-57b3-8259-05926d015214_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2446617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/c1/63c1db3f66f39cb73b6a77a8604e1aee/pa/ST31185_c409e6f40d6c2b60d0962e8d1744a441.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 1.6 T2',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST31185%27 HTTP/1.1" 200 None
2026-03-27 20:39:21 [auto1.be] INFO: Saving data for ST31185: {'created_time': 1774643961.620649, 'last_price_update_time': 1774643961.620661, 'auction_closing_time': 1774715390.0}
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST31185') HTTP/1.1" 204 0
2026-03-27 20:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb53b1f5-1571-55c4-a204-54bb00ae9e30 with identifier: HY09771
2026-03-27 20:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb53b1f5-1571-55c4-a204-54bb00ae9e30 with identifier: HY09771
2026-03-27 20:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb53b1f5-1571-55c4-a204-54bb00ae9e30 with identifier: HY09771 to the API
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_b362db973239d72eecb3085493760be3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:10:51Z',
 'fuel_type': 'petrol',
 'id': 'cb53b1f5-1571-55c4-a204-54bb00ae9e30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY09771',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 77717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_12d39436dd519d98970a6ab0addfe254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_b362db973239d72eecb3085493760be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_14fe48914e67aa137cbe820aa829b0d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_a53563a79fc863e42fb74a53a90be743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_0e7cfe49e0e5b11607df54f58a766b83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb53b1f5-1571-55c4-a204-54bb00ae9e30/cb53b1f5-1571-55c4-a204-54bb00ae9e30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/00/d5006ac42af76f679ee43b19a4864387/pa/HY09771_465f533195bd78334b15c618b9df048d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2004}
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY09771%27 HTTP/1.1" 200 None
2026-03-27 20:39:21 [auto1.be] INFO: Saving data for HY09771: {'created_time': 1774643961.947257, 'last_price_update_time': 1774643961.947268, 'auction_closing_time': 1774714251.0}
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY09771') HTTP/1.1" 204 0
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_acb087971cc7e615b9effd9a66b527ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_acb087971cc7e615b9effd9a66b527ef.jpg not downloaded yet
2026-03-27 20:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_83d335d55e4acb2a49a34f0579338c2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA13965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS46918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ78935> (referer: https://www.auto1.com/v1/car-details-view/VZ78935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ee2ad0>
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F7e%252F187e849992d7ac33aeaef5fbe7cee37a%252Fpa%252FFR50529_7a89edd3f3d2956678519104bfc82309.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7a89edd3f3d2956678519104bfc82309.jpg saved to cache
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8b3ee22-69db-552c-8395-dc8bade66c5b
2026-03-27 20:39:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8b3ee22-69db-552c-8395-dc8bade66c5b, skipping ID generation
2026-03-27 20:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b3ee22-69db-552c-8395-dc8bade66c5b with scrape type 1
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8b3ee22-69db-552c-8395-dc8bade66c5b sending to next pipeline
2026-03-27 20:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8b3ee22-69db-552c-8395-dc8bade66c5b, identifier: FR50529
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_061af275a31c19a034eddf8d833687a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_061af275a31c19a034eddf8d833687a0.jpg not downloaded yet
2026-03-27 20:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU40891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ47299/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ16543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-27 20:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529
2026-03-27 20:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8b3ee22-69db-552c-8395-dc8bade66c5b with identifier: FR50529 to the API
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7a89edd3f3d2956678519104bfc82309.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:00:48Z',
 'fuel_type': 'diesel',
 'id': 'd8b3ee22-69db-552c-8395-dc8bade66c5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR50529',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 154582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3277123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b9b85e61875001d50d9fd01a21db266a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3134493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7b87897982836167d535bc2964104080.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274286,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_bcbfdac33c63646bc003232b11ec88f6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219096,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_1c66f7bb563c8634bb68f81a2cafdded.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278992,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_c7d21beafc9acbd0677a8260b8ccf51e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273565,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_cc09c0f8c53bfd6d38876830595e769e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227614,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_86e4e931d5cd704eeea8103293f906c0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314359,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_7a89edd3f3d2956678519104bfc82309.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3226245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_5484c9c80c48d3678c9466c1cb564272.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b3ee22-69db-552c-8395-dc8bade66c5b/d8b3ee22-69db-552c-8395-dc8bade66c5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327181,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img18/7e/187e849992d7ac33aeaef5fbe7cee37a/pa/FR50529_b59bf518ce1bf6a2705d8036aa614e10.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2020}
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [auto1.be] INFO: Saving data for FR50529: {'created_time': 1774643962.48001, 'last_price_update_time': 1774643962.48002, 'auction_closing_time': 1774713648.0}
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR50529') HTTP/1.1" 204 0
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_8cecd220e8a5a748c223f9124d8503de.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_8cecd220e8a5a748c223f9124d8503de.jpg not downloaded yet
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033dc650>
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_83d335d55e4acb2a49a34f0579338c2c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_83d335d55e4acb2a49a34f0579338c2c.jpg saved to cache
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76329f7b-2ec6-53ed-928c-109f9d364699
2026-03-27 20:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-27 20:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with scrape type 1
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_f972462c47d52d85c2d4a7acb96eb3d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f972462c47d52d85c2d4a7acb96eb3d2.jpg not downloaded yet
2026-03-27 20:39:22 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1659 | hits on page: 40
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_b0807f148ada3af21adb66299c872e97.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_b0807f148ada3af21adb66299c872e97.jpg not downloaded yet
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_6ba2e53a5f1cbd9a3c729bbad4cb18b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_6ba2e53a5f1cbd9a3c729bbad4cb18b5.jpg not downloaded yet
2026-03-27 20:39:22 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [auto1.be] INFO: Scrape type for XJ24324: 1
2026-03-27 20:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_2de8212348275120d76d9e6c242dd315.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_dc109fc890f7d81aab05935f3a4bdeed.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_c3c52b2d750f71652f2b6e53eaf7109f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_c3c52b2d750f71652f2b6e53eaf7109f.jpg not downloaded yet
2026-03-27 20:39:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_d5f889c65ee17ab495cb2817c27a9819.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d5f889c65ee17ab495cb2817c27a9819.jpg not downloaded yet
2026-03-27 20:39:22 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-27 20:39:22 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [auto1.be] INFO: Scrape type for GS99704: 1
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_9d3653e13539d8890649c4cd57ac0cc1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_9d3653e13539d8890649c4cd57ac0cc1.jpg not downloaded yet
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_0a421d2ea0debbda3249c8862d564379.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0a421d2ea0debbda3249c8862d564379.jpg not downloaded yet
2026-03-27 20:39:22 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-27 20:39:22 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [auto1.be] INFO: Scrape type for CD53749: 2
2026-03-27 20:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-27 20:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340357b4-4fa8-5a28-b374-517e6f18c66f with scrape type 2
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340357b4-4fa8-5a28-b374-517e6f18c66f with scrape type 2
2026-03-27 20:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 340357b4-4fa8-5a28-b374-517e6f18c66f, identifier: CD53749
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_6b5f27edd363030348d00978b6d218a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_6b5f27edd363030348d00978b6d218a1.jpg not downloaded yet
2026-03-27 20:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-27 20:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749
2026-03-27 20:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 340357b4-4fa8-5a28-b374-517e6f18c66f with identifier: CD53749 to the API
2026-03-27 20:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:33:13Z',
 'fuel_type': 'diesel',
 'id': '340357b4-4fa8-5a28-b374-517e6f18c66f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD53749',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 269576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-02',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [auto1.be] INFO: Saving data for CD53749: {'auction_closing_time': 1774715593.0, 'created_time': 1773909331.016785, 'last_price_update_time': 1774643963.135919}
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD53749') HTTP/1.1" 204 0
2026-03-27 20:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW24606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_e4e42bd61333ab18734fd46436c10618.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_e4e42bd61333ab18734fd46436c10618.jpg not downloaded yet
2026-03-27 20:39:23 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT14549%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [auto1.be] INFO: Scrape type for VT14549: 1
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_d087a6eb642c6055e41ede0d6fae4d9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d087a6eb642c6055e41ede0d6fae4d9a.jpg not downloaded yet
2026-03-27 20:39:23 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG79733%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [auto1.be] INFO: Scrape type for WG79733: 1
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903168410>
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_2de8212348275120d76d9e6c242dd315.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_2de8212348275120d76d9e6c242dd315.jpg saved to cache
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76329f7b-2ec6-53ed-928c-109f9d364699
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c4bbd0>
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F3a%252Fed3a318f7d2ce901453a234d09d9f750%252Fpa%252FZZ47044_dc109fc890f7d81aab05935f3a4bdeed.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_dc109fc890f7d81aab05935f3a4bdeed.jpg saved to cache
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76329f7b-2ec6-53ed-928c-109f9d364699
2026-03-27 20:39:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76329f7b-2ec6-53ed-928c-109f9d364699, skipping ID generation
2026-03-27 20:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76329f7b-2ec6-53ed-928c-109f9d364699 with scrape type 1
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76329f7b-2ec6-53ed-928c-109f9d364699 sending to next pipeline
2026-03-27 20:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76329f7b-2ec6-53ed-928c-109f9d364699, identifier: ZZ47044
2026-03-27 20:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-27 20:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044
2026-03-27 20:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76329f7b-2ec6-53ed-928c-109f9d364699 with identifier: ZZ47044 to the API
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_dc109fc890f7d81aab05935f3a4bdeed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:16:21Z',
 'fuel_type': 'diesel',
 'id': '76329f7b-2ec6-53ed-928c-109f9d364699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ47044',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 241719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_2de8212348275120d76d9e6c242dd315.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_dc109fc890f7d81aab05935f3a4bdeed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_334bbf972e78917fdf642d014aa79343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_f2909fa067106b8800a6e629eb4c0333.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_83d335d55e4acb2a49a34f0579338c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76329f7b-2ec6-53ed-928c-109f9d364699/76329f7b-2ec6-53ed-928c-109f9d364699_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/3a/ed3a318f7d2ce901453a234d09d9f750/pa/ZZ47044_b1cd1e53ddf9741638af8345081461a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2008}
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [auto1.be] INFO: Saving data for ZZ47044: {'created_time': 1774643963.728874, 'last_price_update_time': 1774643963.728885, 'auction_closing_time': 1774714581.0}
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ47044') HTTP/1.1" 204 0
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_59de57b46656757c294d5499d26c4ff3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_59de57b46656757c294d5499d26c4ff3.jpg not downloaded yet
2026-03-27 20:39:23 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-27 20:39:23 [auto1.be] INFO: Scrape type for ZF81780: 2
2026-03-27 20:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-27 20:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with scrape type 2
2026-03-27 20:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with scrape type 2
2026-03-27 20:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd, identifier: ZF81780
2026-03-27 20:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-27 20:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780
2026-03-27 20:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41a330b3-77fb-5f45-a13c-30c8a3ef8bcd with identifier: ZF81780 to the API
2026-03-27 20:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:24:47Z',
 'fuel_type': 'diesel',
 'id': '41a330b3-77fb-5f45-a13c-30c8a3ef8bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF81780',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 117277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi HDi',
 'transmission': 'manual',
 'trim': 'HDi',
 'year': 2015}
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [auto1.be] INFO: Saving data for ZF81780: {'auction_closing_time': 1774715087.0, 'created_time': 1773224453.84415, 'last_price_update_time': 1774643964.138757}
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF81780') HTTP/1.1" 204 0
2026-03-27 20:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG48907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_f94d87829adb66826647b33b0862ba9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f94d87829adb66826647b33b0862ba9a.jpg not downloaded yet
2026-03-27 20:39:24 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [auto1.be] INFO: Scrape type for NN67810: 2
2026-03-27 20:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-27 20:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with scrape type 2
2026-03-27 20:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with scrape type 2
2026-03-27 20:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c, identifier: NN67810
2026-03-27 20:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ48466> (referer: https://www.auto1.com/v1/car-details-view/XZ48466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-27 20:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810
2026-03-27 20:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c84a2c8-1673-5dc0-b808-2ff7f68abf5c with identifier: NN67810 to the API
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:23:24Z',
 'fuel_type': 'hybrid',
 'id': '7c84a2c8-1673-5dc0-b808-2ff7f68abf5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN67810',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 53096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [auto1.be] INFO: Saving data for NN67810: {'auction_closing_time': 1774715004.0, 'created_time': 1773909343.020222, 'last_price_update_time': 1774643964.721793}
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN67810') HTTP/1.1" 204 0
2026-03-27 20:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_0ca18c313e56899c0321ac532f589eb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0ca18c313e56899c0321ac532f589eb4.jpg not downloaded yet
2026-03-27 20:39:24 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-27 20:39:24 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-27 20:39:24 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-27 20:39:24 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [auto1.be] INFO: Scrape type for GH94733: 1
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_66cdc61b481b19bcd0aa8f15b9fe393b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_66cdc61b481b19bcd0aa8f15b9fe393b.jpg not downloaded yet
2026-03-27 20:39:24 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-27 20:39:24 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [auto1.be] INFO: Scrape type for KC33551: 2
2026-03-27 20:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-27 20:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea5be3c-34ec-5c73-b35c-a191c18de72f with scrape type 2
2026-03-27 20:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea5be3c-34ec-5c73-b35c-a191c18de72f with scrape type 2
2026-03-27 20:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ea5be3c-34ec-5c73-b35c-a191c18de72f, identifier: KC33551
2026-03-27 20:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-27 20:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d284c50-6d79-5bb3-af67-aed85c560e66 with scrape type 1
2026-03-27 20:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_b2ba9ae7369c8053fa0660d7935a3b2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_b2ba9ae7369c8053fa0660d7935a3b2f.jpg not downloaded yet
2026-03-27 20:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-27 20:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551
2026-03-27 20:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ea5be3c-34ec-5c73-b35c-a191c18de72f with identifier: KC33551 to the API
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:14:39Z',
 'fuel_type': 'diesel',
 'id': '0ea5be3c-34ec-5c73-b35c-a191c18de72f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC33551',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 291273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Saving data for KC33551: {'auction_closing_time': 1774714479.0, 'created_time': 1773953365.939709, 'last_price_update_time': 1774643965.237693}
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC33551') HTTP/1.1" 204 0
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Scrape type for GF24104: 1
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_e1146d482b684763cada3c51f1c5b8c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e1146d482b684763cada3c51f1c5b8c4.jpg not downloaded yet
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB76910%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Scrape type for GB76910: 1
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_92b308174b65870be2c9e94d638b0963.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_92b308174b65870be2c9e94d638b0963.jpg not downloaded yet
2026-03-27 20:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ16543> (referer: https://www.auto1.com/v1/car-details-view/JZ16543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Scrape type for HP74170: 1
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_3cbf7f35450c613b982e686fa7da92f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_3cbf7f35450c613b982e686fa7da92f0.jpg not downloaded yet
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF72066%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Scrape type for WF72066: 1
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_c6475bbfab7c96766f8eb01388ee40c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_c6475bbfab7c96766f8eb01388ee40c3.jpg not downloaded yet
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR14818%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Scrape type for RR14818: 2
2026-03-27 20:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab20a634-7a35-5c27-b0df-a0e58cbaaf45 with identifier: RR14818
2026-03-27 20:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab20a634-7a35-5c27-b0df-a0e58cbaaf45 with scrape type 2
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab20a634-7a35-5c27-b0df-a0e58cbaaf45 with scrape type 2
2026-03-27 20:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab20a634-7a35-5c27-b0df-a0e58cbaaf45, identifier: RR14818
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_1ca0ab3354943a3ad44aa67473a27c1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_1ca0ab3354943a3ad44aa67473a27c1f.jpg not downloaded yet
2026-03-27 20:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab20a634-7a35-5c27-b0df-a0e58cbaaf45 with identifier: RR14818
2026-03-27 20:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab20a634-7a35-5c27-b0df-a0e58cbaaf45 with identifier: RR14818
2026-03-27 20:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab20a634-7a35-5c27-b0df-a0e58cbaaf45 with identifier: RR14818 to the API
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:05Z',
 'fuel_type': 'diesel',
 'id': 'ab20a634-7a35-5c27-b0df-a0e58cbaaf45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR14818',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 275703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-07',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Urban 4WD',
 'transmission': 'automatic',
 'trim': 'Urban 4WD',
 'year': 2013}
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR14818%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Saving data for RR14818: {'auction_closing_time': 1774716125.0, 'created_time': 1773434436.871727, 'last_price_update_time': 1774643965.852565}
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR14818') HTTP/1.1" 204 0
2026-03-27 20:39:25 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [auto1.be] INFO: Scrape type for SC59712: 1
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_99f3988f09285495b24b9bd223e3cefa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_99f3988f09285495b24b9bd223e3cefa.jpg not downloaded yet
2026-03-27 20:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-27 20:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0873f4e9-2bac-5146-829e-773bd08d7257 with scrape type 1
2026-03-27 20:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0873f4e9-2bac-5146-829e-773bd08d7257
2026-03-27 20:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_cd6073354d817a377d941d16adb0a9e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_cd6073354d817a377d941d16adb0a9e1.jpg not downloaded yet
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for WL65720: 1
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_4b340b1061a604f71bb5bd7ffdb1b0cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_4b340b1061a604f71bb5bd7ffdb1b0cc.jpg not downloaded yet
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_0d4b06143809a12ce0feb07fbc32e38b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_0d4b06143809a12ce0feb07fbc32e38b.jpg not downloaded yet
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC34183%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for RC34183: 0
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ41655%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for VZ41655: 0
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-27 20:39:26 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10971%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [auto1.be] INFO: Scrape type for TY10971: 0
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_e8a5120c424e103d2e4df368bc213ee5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e8a5120c424e103d2e4df368bc213ee5.jpg not downloaded yet
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_6e94ab7e3e81197b3408f822267dc3c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6e94ab7e3e81197b3408f822267dc3c5.jpg not downloaded yet
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_223468aa845d992ea630c7632732a13a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_223468aa845d992ea630c7632732a13a.jpg not downloaded yet
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_6374e0b7d50d5df910baf808e913caef.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6374e0b7d50d5df910baf808e913caef.jpg not downloaded yet
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_0c5893374db1b8e7a860a851e17d2d07.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_f65f16da8797ffc296d1cb52e9b522fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_acb087971cc7e615b9effd9a66b527ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_f08a4595aaabb40888fdc780227e845d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_f08a4595aaabb40888fdc780227e845d.jpg not downloaded yet
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_38be71b5c027124c3ae99ed6dd5adca2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_38be71b5c027124c3ae99ed6dd5adca2.jpg not downloaded yet
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_38ee106f8406a3f9ca834dcef6fc92b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_853afa9ebccd909202d8c8476fb3d50c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_08d33287345aeab89cac3a6aa4e3eaa9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_a80be68c0d571083ea3d3c8fe2b25bbe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_24c8290e4d796e4b6848b3d95a871579.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912305190>
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_0c5893374db1b8e7a860a851e17d2d07.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_0c5893374db1b8e7a860a851e17d2d07.jpg saved to cache
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e1146d482b684763cada3c51f1c5b8c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d98e90>
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_f65f16da8797ffc296d1cb52e9b522fb.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_f65f16da8797ffc296d1cb52e9b522fb.jpg saved to cache
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdc0d0>
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_acb087971cc7e615b9effd9a66b527ef.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_acb087971cc7e615b9effd9a66b527ef.jpg saved to cache
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e6a10>
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_38ee106f8406a3f9ca834dcef6fc92b0.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_38ee106f8406a3f9ca834dcef6fc92b0.jpg saved to cache
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9eb90>
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_853afa9ebccd909202d8c8476fb3d50c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_853afa9ebccd909202d8c8476fb3d50c.jpg saved to cache
2026-03-27 20:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:39:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ebc90>
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_08d33287345aeab89cac3a6aa4e3eaa9.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_08d33287345aeab89cac3a6aa4e3eaa9.jpg saved to cache
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9f950>
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_a80be68c0d571083ea3d3c8fe2b25bbe.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_a80be68c0d571083ea3d3c8fe2b25bbe.jpg saved to cache
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90339e250>
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_24c8290e4d796e4b6848b3d95a871579.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_24c8290e4d796e4b6848b3d95a871579.jpg saved to cache
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG79733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033d53d0>
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_e1146d482b684763cada3c51f1c5b8c4.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e1146d482b684763cada3c51f1c5b8c4.jpg saved to cache
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_dcca55fc74ed5b55028fe36e40e078d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_882740f2cb6f33a959af2494f82213ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_b0807f148ada3af21adb66299c872e97.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_59de57b46656757c294d5499d26c4ff3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_f08a4595aaabb40888fdc780227e845d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_38be71b5c027124c3ae99ed6dd5adca2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e8a5120c424e103d2e4df368bc213ee5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_223468aa845d992ea630c7632732a13a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6374e0b7d50d5df910baf808e913caef.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6e94ab7e3e81197b3408f822267dc3c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_0d4b06143809a12ce0feb07fbc32e38b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_cd6073354d817a377d941d16adb0a9e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0a421d2ea0debbda3249c8862d564379.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d6f550>
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_dcca55fc74ed5b55028fe36e40e078d3.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_dcca55fc74ed5b55028fe36e40e078d3.jpg saved to cache
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_4b340b1061a604f71bb5bd7ffdb1b0cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_99f3988f09285495b24b9bd223e3cefa.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c68290>
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_882740f2cb6f33a959af2494f82213ac.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_882740f2cb6f33a959af2494f82213ac.jpg saved to cache
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dea450>
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_b0807f148ada3af21adb66299c872e97.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_b0807f148ada3af21adb66299c872e97.jpg saved to cache
2026-03-27 20:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903054190>
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_59de57b46656757c294d5499d26c4ff3.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_59de57b46656757c294d5499d26c4ff3.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dc2390>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_f08a4595aaabb40888fdc780227e845d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_f08a4595aaabb40888fdc780227e845d.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0873f4e9-2bac-5146-829e-773bd08d7257
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c67d50>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_38be71b5c027124c3ae99ed6dd5adca2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_38be71b5c027124c3ae99ed6dd5adca2.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0873f4e9-2bac-5146-829e-773bd08d7257
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903deb5d0>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_e8a5120c424e103d2e4df368bc213ee5.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e8a5120c424e103d2e4df368bc213ee5.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903056c90>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_223468aa845d992ea630c7632732a13a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_223468aa845d992ea630c7632732a13a.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e33dd0>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_6374e0b7d50d5df910baf808e913caef.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6374e0b7d50d5df910baf808e913caef.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0873f4e9-2bac-5146-829e-773bd08d7257
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dc3590>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_6e94ab7e3e81197b3408f822267dc3c5.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6e94ab7e3e81197b3408f822267dc3c5.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0873f4e9-2bac-5146-829e-773bd08d7257
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e7c90>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_0d4b06143809a12ce0feb07fbc32e38b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_0d4b06143809a12ce0feb07fbc32e38b.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0873f4e9-2bac-5146-829e-773bd08d7257
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90321e590>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F65%252Fbc65afb76372559741b59af33c357e38%252Fpa%252FJZ16543_cd6073354d817a377d941d16adb0a9e1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_cd6073354d817a377d941d16adb0a9e1.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0873f4e9-2bac-5146-829e-773bd08d7257
2026-03-27 20:39:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0873f4e9-2bac-5146-829e-773bd08d7257, skipping ID generation
2026-03-27 20:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0873f4e9-2bac-5146-829e-773bd08d7257 with scrape type 1
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0873f4e9-2bac-5146-829e-773bd08d7257 sending to next pipeline
2026-03-27 20:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0873f4e9-2bac-5146-829e-773bd08d7257, identifier: JZ16543
2026-03-27 20:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e834d0>
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_0a421d2ea0debbda3249c8862d564379.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0a421d2ea0debbda3249c8862d564379.jpg saved to cache
2026-03-27 20:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-27 20:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543
2026-03-27 20:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0873f4e9-2bac-5146-829e-773bd08d7257 with identifier: JZ16543 to the API
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_cd6073354d817a377d941d16adb0a9e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:40:56Z',
 'fuel_type': 'diesel',
 'id': '0873f4e9-2bac-5146-829e-773bd08d7257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ16543',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 235945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_cd6073354d817a377d941d16adb0a9e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_0d4b06143809a12ce0feb07fbc32e38b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6e94ab7e3e81197b3408f822267dc3c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_6374e0b7d50d5df910baf808e913caef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_f08a4595aaabb40888fdc780227e845d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0873f4e9-2bac-5146-829e-773bd08d7257/0873f4e9-2bac-5146-829e-773bd08d7257_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/65/bc65afb76372559741b59af33c357e38/pa/JZ16543_38be71b5c027124c3ae99ed6dd5adca2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-27 20:39:29 [auto1.be] INFO: Saving data for JZ16543: {'created_time': 1774643969.23016, 'last_price_update_time': 1774643969.23017, 'auction_closing_time': 1774716056.0}
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ16543') HTTP/1.1" 204 0
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL65720/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9b450>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_4b340b1061a604f71bb5bd7ffdb1b0cc.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_4b340b1061a604f71bb5bd7ffdb1b0cc.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90312d990>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_99f3988f09285495b24b9bd223e3cefa.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_99f3988f09285495b24b9bd223e3cefa.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_7d15f8b3cef647c0519e95e9627bae65.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_b2ba9ae7369c8053fa0660d7935a3b2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_92b308174b65870be2c9e94d638b0963.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_3cbf7f35450c613b982e686fa7da92f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90312d6d0>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_7d15f8b3cef647c0519e95e9627bae65.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_7d15f8b3cef647c0519e95e9627bae65.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_1ca0ab3354943a3ad44aa67473a27c1f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e9a10>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_b2ba9ae7369c8053fa0660d7935a3b2f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_b2ba9ae7369c8053fa0660d7935a3b2f.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9e350>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_92b308174b65870be2c9e94d638b0963.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_92b308174b65870be2c9e94d638b0963.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903315ad0>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_3cbf7f35450c613b982e686fa7da92f0.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_3cbf7f35450c613b982e686fa7da92f0.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_c6475bbfab7c96766f8eb01388ee40c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f39d0>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_1ca0ab3354943a3ad44aa67473a27c1f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_1ca0ab3354943a3ad44aa67473a27c1f.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0ca18c313e56899c0321ac532f589eb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90318d4d0>
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F8f%252F698fe34959a9667fba1123ef9781280c%252Fpa%252FXZ48466_c6475bbfab7c96766f8eb01388ee40c3.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_c6475bbfab7c96766f8eb01388ee40c3.jpg saved to cache
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d284c50-6d79-5bb3-af67-aed85c560e66
2026-03-27 20:39:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d284c50-6d79-5bb3-af67-aed85c560e66, skipping ID generation
2026-03-27 20:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d284c50-6d79-5bb3-af67-aed85c560e66 with scrape type 1
2026-03-27 20:39:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d284c50-6d79-5bb3-af67-aed85c560e66 sending to next pipeline
2026-03-27 20:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d284c50-6d79-5bb3-af67-aed85c560e66, identifier: XZ48466
2026-03-27 20:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-27 20:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466
2026-03-27 20:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d284c50-6d79-5bb3-af67-aed85c560e66 with identifier: XZ48466 to the API
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_c6475bbfab7c96766f8eb01388ee40c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:58:57Z',
 'fuel_type': 'petrol',
 'id': '8d284c50-6d79-5bb3-af67-aed85c560e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ48466',
 'listing': 'auction',
 'location': 'BE, Gosselies',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 151715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_b2ba9ae7369c8053fa0660d7935a3b2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e1146d482b684763cada3c51f1c5b8c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_92b308174b65870be2c9e94d638b0963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_3cbf7f35450c613b982e686fa7da92f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_c6475bbfab7c96766f8eb01388ee40c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_1ca0ab3354943a3ad44aa67473a27c1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_99f3988f09285495b24b9bd223e3cefa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_4b340b1061a604f71bb5bd7ffdb1b0cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_e8a5120c424e103d2e4df368bc213ee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d284c50-6d79-5bb3-af67-aed85c560e66/8d284c50-6d79-5bb3-af67-aed85c560e66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/8f/698fe34959a9667fba1123ef9781280c/pa/XZ48466_223468aa845d992ea630c7632732a13a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2009}
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [auto1.be] INFO: Saving data for XZ48466: {'created_time': 1774643970.568567, 'last_price_update_time': 1774643970.568577, 'auction_closing_time': 1774717137.0}
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ48466') HTTP/1.1" 204 0
2026-03-27 20:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG79733> (referer: https://www.auto1.com/v1/car-details-view/WG79733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP74170/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF24104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG48907> (referer: https://www.auto1.com/v1/car-details-view/LG48907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH94733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF72066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031cbe50>
2026-03-27 20:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_0ca18c313e56899c0321ac532f589eb4.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0ca18c313e56899c0321ac532f589eb4.jpg saved to cache
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd551289-d6dd-52aa-874e-0b2653eb537b with identifier: WG79733
2026-03-27 20:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd551289-d6dd-52aa-874e-0b2653eb537b with scrape type 1
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cd551289-d6dd-52aa-874e-0b2653eb537b
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_a0605dd747887b0988819b30018a6a91.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_a0605dd747887b0988819b30018a6a91.jpg not downloaded yet
2026-03-27 20:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907
2026-03-27 20:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c419b186-aadc-5314-aa68-46ecded792e9 with scrape type 1
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_ed1fd00f3c56964f61334aa5978e90be.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_ed1fd00f3c56964f61334aa5978e90be.jpg not downloaded yet
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_aa27467feb410d3f2b6e4dbf0ec1ffb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_aa27467feb410d3f2b6e4dbf0ec1ffb8.jpg not downloaded yet
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_fb1a9a31d1d6833a5d4f82930e1e99d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_fb1a9a31d1d6833a5d4f82930e1e99d1.jpg not downloaded yet
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_25e890945272251b0544d60f43da8957.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_25e890945272251b0544d60f43da8957.jpg not downloaded yet
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_2de4bc9ddeaed84e61d3c10e4da1647f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_2de4bc9ddeaed84e61d3c10e4da1647f.jpg not downloaded yet
2026-03-27 20:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB76910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_4b44afe3083185d5888c9f1ec1473210.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_4b44afe3083185d5888c9f1ec1473210.jpg not downloaded yet
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_a9b033a4de2c657c5adee3b926b3d3e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_a9b033a4de2c657c5adee3b926b3d3e2.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_c8022fab776ef7c48433fcef2994e925.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_c8022fab776ef7c48433fcef2994e925.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_b014c209e056c07b763857df0733e650.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_b014c209e056c07b763857df0733e650.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_fb276dfadd8a208811a5ac91c1b59c42.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_fb276dfadd8a208811a5ac91c1b59c42.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_c53ca41cbcf9c67eaa491b6e76dc76f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_c53ca41cbcf9c67eaa491b6e76dc76f7.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_d8461ba70963aff0ffa0e44539b46c12.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_d8461ba70963aff0ffa0e44539b46c12.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_3012f70d57040a0f9f2b7f1f84ca2bc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_3012f70d57040a0f9f2b7f1f84ca2bc6.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_261fe380ecc43e0ae35ee204e58c13a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_261fe380ecc43e0ae35ee204e58c13a2.jpg not downloaded yet
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_155f196f873ab9950a472af9c7a3297f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_155f196f873ab9950a472af9c7a3297f.jpg not downloaded yet
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_66cdc61b481b19bcd0aa8f15b9fe393b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d087a6eb642c6055e41ede0d6fae4d9a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_e4e42bd61333ab18734fd46436c10618.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f94d87829adb66826647b33b0862ba9a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_6b5f27edd363030348d00978b6d218a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_9d3653e13539d8890649c4cd57ac0cc1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_c3c52b2d750f71652f2b6e53eaf7109f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_155f196f873ab9950a472af9c7a3297f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e6f5d0>
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_66cdc61b481b19bcd0aa8f15b9fe393b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_66cdc61b481b19bcd0aa8f15b9fe393b.jpg saved to cache
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903270a50>
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_d087a6eb642c6055e41ede0d6fae4d9a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d087a6eb642c6055e41ede0d6fae4d9a.jpg saved to cache
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903170d90>
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_e4e42bd61333ab18734fd46436c10618.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_e4e42bd61333ab18734fd46436c10618.jpg saved to cache
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90322f650>
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_f94d87829adb66826647b33b0862ba9a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f94d87829adb66826647b33b0862ba9a.jpg saved to cache
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032ce790>
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_6b5f27edd363030348d00978b6d218a1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_6b5f27edd363030348d00978b6d218a1.jpg saved to cache
2026-03-27 20:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912114e90>
2026-03-27 20:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_9d3653e13539d8890649c4cd57ac0cc1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_9d3653e13539d8890649c4cd57ac0cc1.jpg saved to cache
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f30d0>
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_c3c52b2d750f71652f2b6e53eaf7109f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_c3c52b2d750f71652f2b6e53eaf7109f.jpg saved to cache
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe91210e390>
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_155f196f873ab9950a472af9c7a3297f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_155f196f873ab9950a472af9c7a3297f.jpg saved to cache
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL65720> (referer: https://www.auto1.com/v1/car-details-view/WL65720/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ24324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT14549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS99704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW24606> (referer: https://www.auto1.com/v1/car-details-view/WW24606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_2de4bc9ddeaed84e61d3c10e4da1647f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d5f889c65ee17ab495cb2817c27a9819.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_fb276dfadd8a208811a5ac91c1b59c42.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_c8022fab776ef7c48433fcef2994e925.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-27 20:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with scrape type 1
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_9e8fac78b9fbce0679e793b8bdc5ebf6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_9e8fac78b9fbce0679e793b8bdc5ebf6.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_f037f99c669bcbfc2efccb117c423172.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_f037f99c669bcbfc2efccb117c423172.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_9a736ec70b1dd4867226a92868ead983.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_9a736ec70b1dd4867226a92868ead983.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_164cba7e8ea8db77f7eff9c533b458be.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_164cba7e8ea8db77f7eff9c533b458be.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_5f0e4411c42862efe4f96150207e66f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_5f0e4411c42862efe4f96150207e66f7.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_6999a07f76222a43436b2ee3f51e6e9f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_6999a07f76222a43436b2ee3f51e6e9f.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_94dcb660f8e75fe69f4c18a31fc0fd6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_94dcb660f8e75fe69f4c18a31fc0fd6a.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_fabe90ada67f6736b28eedc622a882d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_fabe90ada67f6736b28eedc622a882d4.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_21f98240173c5bf08a1eb3b70650f3b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_21f98240173c5bf08a1eb3b70650f3b9.jpg already downloaded
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F00%252Fbe0084e5eca2bdeb32785404cb5d75fd%252Fpa%252FWL65720_f81a92595b23a500a40130340e7941f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_f81a92595b23a500a40130340e7941f3.jpg already downloaded
2026-03-27 20:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2, identifier: WL65720
2026-03-27 20:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0961c7e7-aaaa-5e53-be76-b20506cee12e with identifier: WW24606
2026-03-27 20:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0961c7e7-aaaa-5e53-be76-b20506cee12e with scrape type 1
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_d05b8db9353910b8e4dc1d62f9d3b109.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_d05b8db9353910b8e4dc1d62f9d3b109.jpg not downloaded yet
2026-03-27 20:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-27 20:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720
2026-03-27 20:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2 with identifier: WL65720 to the API
2026-03-27 20:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL65720>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:22:02Z',
 'fuel_type': 'diesel',
 'id': '44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL65720',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_9e8fac78b9fbce0679e793b8bdc5ebf6.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_f037f99c669bcbfc2efccb117c423172.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_9a736ec70b1dd4867226a92868ead983.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_164cba7e8ea8db77f7eff9c533b458be.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_5f0e4411c42862efe4f96150207e66f7.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_6999a07f76222a43436b2ee3f51e6e9f.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_94dcb660f8e75fe69f4c18a31fc0fd6a.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_fabe90ada67f6736b28eedc622a882d4.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_21f98240173c5bf08a1eb3b70650f3b9.jpg',
                'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_f81a92595b23a500a40130340e7941f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_9e8fac78b9fbce0679e793b8bdc5ebf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_f037f99c669bcbfc2efccb117c423172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_9a736ec70b1dd4867226a92868ead983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_164cba7e8ea8db77f7eff9c533b458be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_5f0e4411c42862efe4f96150207e66f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_6999a07f76222a43436b2ee3f51e6e9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_94dcb660f8e75fe69f4c18a31fc0fd6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_fabe90ada67f6736b28eedc622a882d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_21f98240173c5bf08a1eb3b70650f3b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2/44c8ae0e-9ae8-5bc3-b3cc-fdd6779557f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/00/be0084e5eca2bdeb32785404cb5d75fd/pa/WL65720_f81a92595b23a500a40130340e7941f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [auto1.be] INFO: Saving data for WL65720: {'created_time': 1774643973.099878, 'last_price_update_time': 1774643973.099888, 'auction_closing_time': 1774714922.0}
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL65720') HTTP/1.1" 204 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_054cd9ef6fe2e13442a22f7b02a52b47.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_054cd9ef6fe2e13442a22f7b02a52b47.jpg not downloaded yet
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_4b44afe3083185d5888c9f1ec1473210.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_405cd49e3700a5257556ced29b2d2ce7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_405cd49e3700a5257556ced29b2d2ce7.jpg not downloaded yet
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9fdd0>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_2de4bc9ddeaed84e61d3c10e4da1647f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_2de4bc9ddeaed84e61d3c10e4da1647f.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031a7490>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_d5f889c65ee17ab495cb2817c27a9819.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d5f889c65ee17ab495cb2817c27a9819.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903281710>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_fb276dfadd8a208811a5ac91c1b59c42.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_fb276dfadd8a208811a5ac91c1b59c42.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd551289-d6dd-52aa-874e-0b2653eb537b
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032831d0>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_c8022fab776ef7c48433fcef2994e925.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_c8022fab776ef7c48433fcef2994e925.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd551289-d6dd-52aa-874e-0b2653eb537b
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_3012f70d57040a0f9f2b7f1f84ca2bc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_261fe380ecc43e0ae35ee204e58c13a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_6ba2e53a5f1cbd9a3c729bbad4cb18b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_1b65a55c142138a8e7a34b67be5222d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_1b65a55c142138a8e7a34b67be5222d8.jpg not downloaded yet
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f99390>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_4b44afe3083185d5888c9f1ec1473210.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_4b44afe3083185d5888c9f1ec1473210.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd551289-d6dd-52aa-874e-0b2653eb537b
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_cdc88632857050b7cc47f67ed81719a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_cdc88632857050b7cc47f67ed81719a4.jpg not downloaded yet
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_d8461ba70963aff0ffa0e44539b46c12.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_aa27467feb410d3f2b6e4dbf0ec1ffb8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_25e890945272251b0544d60f43da8957.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_faac03802df1c79a43a03bc1631b133d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_faac03802df1c79a43a03bc1631b133d.jpg not downloaded yet
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_c53ca41cbcf9c67eaa491b6e76dc76f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_c830b29956fbd004ba7061cffc393190.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_c830b29956fbd004ba7061cffc393190.jpg not downloaded yet
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_b014c209e056c07b763857df0733e650.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_9d5b1186769c19056b447e8120a7181b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_9d5b1186769c19056b447e8120a7181b.jpg not downloaded yet
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ee2690>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_3012f70d57040a0f9f2b7f1f84ca2bc6.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_3012f70d57040a0f9f2b7f1f84ca2bc6.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9121293d0>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_261fe380ecc43e0ae35ee204e58c13a2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_261fe380ecc43e0ae35ee204e58c13a2.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e1ea50>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_6ba2e53a5f1cbd9a3c729bbad4cb18b5.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_6ba2e53a5f1cbd9a3c729bbad4cb18b5.jpg saved to cache
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_a9b033a4de2c657c5adee3b926b3d3e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_02fe1b8512c2f82c1382dd7b9a14a4bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_02fe1b8512c2f82c1382dd7b9a14a4bf.jpg not downloaded yet
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_56cd363f08119c4504fbb298ccb69e4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_56cd363f08119c4504fbb298ccb69e4c.jpg not downloaded yet
2026-03-27 20:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c5d410>
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_d8461ba70963aff0ffa0e44539b46c12.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_d8461ba70963aff0ffa0e44539b46c12.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90303d210>
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_aa27467feb410d3f2b6e4dbf0ec1ffb8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_aa27467feb410d3f2b6e4dbf0ec1ffb8.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd551289-d6dd-52aa-874e-0b2653eb537b
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90317fa10>
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_25e890945272251b0544d60f43da8957.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_25e890945272251b0544d60f43da8957.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd551289-d6dd-52aa-874e-0b2653eb537b
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032da910>
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_c53ca41cbcf9c67eaa491b6e76dc76f7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_c53ca41cbcf9c67eaa491b6e76dc76f7.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911e22dd0>
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_b014c209e056c07b763857df0733e650.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_b014c209e056c07b763857df0733e650.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH94733> (referer: https://www.auto1.com/v1/car-details-view/GH94733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB76910> (referer: https://www.auto1.com/v1/car-details-view/GB76910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF72066> (referer: https://www.auto1.com/v1/car-details-view/WF72066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e5ac50>
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_a9b033a4de2c657c5adee3b926b3d3e2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_a9b033a4de2c657c5adee3b926b3d3e2.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_ed1fd00f3c56964f61334aa5978e90be.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_fb1a9a31d1d6833a5d4f82930e1e99d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-27 20:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad6bd01-d645-535d-aa6f-8b8f1581696b with scrape type 1
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_94c80a82c881d06dd2725b91d54d5577.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_94c80a82c881d06dd2725b91d54d5577.jpg not downloaded yet
2026-03-27 20:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7e4404-55e6-57b8-a03b-06eb7c80d1da with identifier: GB76910
2026-03-27 20:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da with scrape type 1
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_5b433caf60459fccd14114472e3db83c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_5b433caf60459fccd14114472e3db83c.jpg not downloaded yet
2026-03-27 20:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1686fde-c240-5912-a1f3-b1a8ca870b08 with identifier: WF72066
2026-03-27 20:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1686fde-c240-5912-a1f3-b1a8ca870b08 with scrape type 1
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_71723aacf1b0b4a833ab6b3e182d2efc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_71723aacf1b0b4a833ab6b3e182d2efc.jpg not downloaded yet
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_050cbd9774c94b4d70d8dbd15d8676b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_050cbd9774c94b4d70d8dbd15d8676b4.jpg not downloaded yet
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_71ccea91b69cb78f4d1cadd60e07c71e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_71ccea91b69cb78f4d1cadd60e07c71e.jpg not downloaded yet
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_dff62f0699a130075ab39e14edec3c2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_dff62f0699a130075ab39e14edec3c2c.jpg not downloaded yet
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_7cdb931582e33ee54b11dbd8682fc417.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_7cdb931582e33ee54b11dbd8682fc417.jpg not downloaded yet
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_e7605c5ab813e9a034cb57892fa78f1a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_e7605c5ab813e9a034cb57892fa78f1a.jpg not downloaded yet
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_756650509fae125b0415ce5a6c6926a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_756650509fae125b0415ce5a6c6926a1.jpg not downloaded yet
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031bc110>
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_ed1fd00f3c56964f61334aa5978e90be.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_ed1fd00f3c56964f61334aa5978e90be.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90339ca50>
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F9c%252F6f9cbc70035d6e8a645bc690f1d4577c%252Fpa%252FLG48907_fb1a9a31d1d6833a5d4f82930e1e99d1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_fb1a9a31d1d6833a5d4f82930e1e99d1.jpg saved to cache
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c419b186-aadc-5314-aa68-46ecded792e9
2026-03-27 20:39:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c419b186-aadc-5314-aa68-46ecded792e9, skipping ID generation
2026-03-27 20:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c419b186-aadc-5314-aa68-46ecded792e9 with scrape type 1
2026-03-27 20:39:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c419b186-aadc-5314-aa68-46ecded792e9 sending to next pipeline
2026-03-27 20:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c419b186-aadc-5314-aa68-46ecded792e9, identifier: LG48907
2026-03-27 20:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_b69b9baed31afe61fe0d7ae72432008e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_b69b9baed31afe61fe0d7ae72432008e.jpg not downloaded yet
2026-03-27 20:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_240f3176caed2148a187710fe8d95d97.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_240f3176caed2148a187710fe8d95d97.jpg not downloaded yet
2026-03-27 20:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_5530f973f9beecb5f00e205e9318cc22.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_5530f973f9beecb5f00e205e9318cc22.jpg not downloaded yet
2026-03-27 20:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907
2026-03-27 20:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907
2026-03-27 20:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c419b186-aadc-5314-aa68-46ecded792e9 with identifier: LG48907 to the API
2026-03-27 20:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_fb1a9a31d1d6833a5d4f82930e1e99d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:27:39Z',
 'fuel_type': 'diesel',
 'id': 'c419b186-aadc-5314-aa68-46ecded792e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG48907',
 'listing': 'auction',
 'location': 'BE',
 'make': 'BMW',
 'model': '3er',
 'odometer': 179052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 925464,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_ed1fd00f3c56964f61334aa5978e90be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 937737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_fb1a9a31d1d6833a5d4f82930e1e99d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_2de4bc9ddeaed84e61d3c10e4da1647f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 956935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_a9b033a4de2c657c5adee3b926b3d3e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1018480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_b014c209e056c07b763857df0733e650.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1097939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_c53ca41cbcf9c67eaa491b6e76dc76f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 921133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_d8461ba70963aff0ffa0e44539b46c12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_3012f70d57040a0f9f2b7f1f84ca2bc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519204,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_261fe380ecc43e0ae35ee204e58c13a2.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c419b186-aadc-5314-aa68-46ecded792e9/c419b186-aadc-5314-aa68-46ecded792e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366291,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/9c/6f9cbc70035d6e8a645bc690f1d4577c/pa/LG48907_155f196f873ab9950a472af9c7a3297f.jpg',
             'Width': 1600}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 20:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-27 20:39:36 [auto1.be] INFO: Saving data for LG48907: {'created_time': 1774643976.953083, 'last_price_update_time': 1774643976.9531, 'auction_closing_time': 1774715259.0}
2026-03-27 20:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG48907') HTTP/1.1" 204 0
2026-03-27 20:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_f6f78b8bd138f2cf30ecdf82f6e4e193.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_f6f78b8bd138f2cf30ecdf82f6e4e193.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_0ba875df50886a759f6179f4332b297a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_0ba875df50886a759f6179f4332b297a.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_4fd4b26b9f1113e9737600bb6d2e169f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_4fd4b26b9f1113e9737600bb6d2e169f.jpg not downloaded yet
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS99704> (referer: https://www.auto1.com/v1/car-details-view/GS99704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_d72d0fd0caa18b0eae3bf27b474dd1dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d72d0fd0caa18b0eae3bf27b474dd1dd.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_be575a03318c384fbd5c66b4de14c5d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_be575a03318c384fbd5c66b4de14c5d4.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_51ceb6d5004a108eb11bf8db90eed35c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_51ceb6d5004a108eb11bf8db90eed35c.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_2019c0a77c18a31c65067aa5e16a0c00.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_2019c0a77c18a31c65067aa5e16a0c00.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_67a07e2f89e91524ae23bd2e8ebac256.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_67a07e2f89e91524ae23bd2e8ebac256.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_82ef7c9ba8488f7cb367ec5d67a8acbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_82ef7c9ba8488f7cb367ec5d67a8acbe.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_3ec0501b29bb4eb4fe85d53b520e850d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_3ec0501b29bb4eb4fe85d53b520e850d.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_fdb8dd6595c3b80b3c482676443cd016.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_fdb8dd6595c3b80b3c482676443cd016.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_285b2cb4478233488a00444e6977421d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_285b2cb4478233488a00444e6977421d.jpg not downloaded yet
2026-03-27 20:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-27 20:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b974b1b6-19de-5e7d-90b5-ef53ef835da4 with scrape type 1
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_86ea9413bf4b3bed676be765cb1a5966.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_86ea9413bf4b3bed676be765cb1a5966.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_4c076c73a237a92d4802c2e14c065ac2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_4c076c73a237a92d4802c2e14c065ac2.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_94bf66421eb31a61962938fe22fe2543.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_94bf66421eb31a61962938fe22fe2543.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_b2909683a0940365c6a5316afea54d5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_b2909683a0940365c6a5316afea54d5b.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_df4d692a6c4687ae82b446d1b492d387.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_df4d692a6c4687ae82b446d1b492d387.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_d17f3c754415b13352a8529574f9e7ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d17f3c754415b13352a8529574f9e7ce.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_181fbbf12145e52bef7799f833f625b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_181fbbf12145e52bef7799f833f625b3.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_27ae87f1b24999fbb7194cb1d4b3ad54.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_27ae87f1b24999fbb7194cb1d4b3ad54.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_a1de2a232191eb812c52f8a5f24b883e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_a1de2a232191eb812c52f8a5f24b883e.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_9761e129ca1255aa8b0cffc988852add.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_9761e129ca1255aa8b0cffc988852add.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_f3792232f4a900a096ef004b69ebc8ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_f3792232f4a900a096ef004b69ebc8ca.jpg not downloaded yet
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_054cd9ef6fe2e13442a22f7b02a52b47.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_53967bf612dbe15b0ac3412dd30a2cc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_53967bf612dbe15b0ac3412dd30a2cc9.jpg not downloaded yet
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_1b65a55c142138a8e7a34b67be5222d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_405cd49e3700a5257556ced29b2d2ce7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_d05b8db9353910b8e4dc1d62f9d3b109.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_6d1368c3eb9c003311270433423453ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_6d1368c3eb9c003311270433423453ce.jpg not downloaded yet
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC59712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_362e2327ee4c047bde671755376c404d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_362e2327ee4c047bde671755376c404d.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_dc35b43a29a18d78ee97e846d3a1d377.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_dc35b43a29a18d78ee97e846d3a1d377.jpg not downloaded yet
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_18f01172707fd55fac081e6cc9c3d24d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_18f01172707fd55fac081e6cc9c3d24d.jpg not downloaded yet
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_9d5b1186769c19056b447e8120a7181b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90319bb90>
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_054cd9ef6fe2e13442a22f7b02a52b47.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_054cd9ef6fe2e13442a22f7b02a52b47.jpg saved to cache
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_02fe1b8512c2f82c1382dd7b9a14a4bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_faac03802df1c79a43a03bc1631b133d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_c830b29956fbd004ba7061cffc393190.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_4fd4b26b9f1113e9737600bb6d2e169f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_f3792232f4a900a096ef004b69ebc8ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP74170> (referer: https://www.auto1.com/v1/car-details-view/HP74170/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ee2ad0>
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_1b65a55c142138a8e7a34b67be5222d8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_1b65a55c142138a8e7a34b67be5222d8.jpg saved to cache
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033fbdd0>
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_405cd49e3700a5257556ced29b2d2ce7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_405cd49e3700a5257556ced29b2d2ce7.jpg saved to cache
2026-03-27 20:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e832d0>
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_d05b8db9353910b8e4dc1d62f9d3b109.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_d05b8db9353910b8e4dc1d62f9d3b109.jpg saved to cache
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90303fc90>
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_9d5b1186769c19056b447e8120a7181b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_9d5b1186769c19056b447e8120a7181b.jpg saved to cache
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT14549> (referer: https://www.auto1.com/v1/car-details-view/VT14549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ24324> (referer: https://www.auto1.com/v1/car-details-view/XJ24324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903285050>
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_02fe1b8512c2f82c1382dd7b9a14a4bf.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_02fe1b8512c2f82c1382dd7b9a14a4bf.jpg saved to cache
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90339dfd0>
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_faac03802df1c79a43a03bc1631b133d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_faac03802df1c79a43a03bc1631b133d.jpg saved to cache
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90300bbd0>
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_c830b29956fbd004ba7061cffc393190.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_c830b29956fbd004ba7061cffc393190.jpg saved to cache
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903230850>
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_4fd4b26b9f1113e9737600bb6d2e169f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_4fd4b26b9f1113e9737600bb6d2e169f.jpg saved to cache
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903db06d0>
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_f3792232f4a900a096ef004b69ebc8ca.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_f3792232f4a900a096ef004b69ebc8ca.jpg saved to cache
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-27 20:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d190d7-ae2b-59be-b179-cfe65922cfe0 with scrape type 1
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_b3e1d01e4319c2e7dc7ed06977423bd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_b3e1d01e4319c2e7dc7ed06977423bd8.jpg not downloaded yet
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_e0830e5f7bb3765b21d3904591212eba.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_e0830e5f7bb3765b21d3904591212eba.jpg not downloaded yet
2026-03-27 20:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_178e4ca33e6f54c2604867ae125fd24b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_178e4ca33e6f54c2604867ae125fd24b.jpg not downloaded yet
2026-03-27 20:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f6511d-037f-5bcc-886f-8fb3735bc0c2 with identifier: VT14549
2026-03-27 20:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2 with scrape type 1
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_f4294178123d212d10f4cf4da9f1de4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_f4294178123d212d10f4cf4da9f1de4f.jpg not downloaded yet
2026-03-27 20:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324
2026-03-27 20:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with scrape type 1
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_e7ac49eabaef4294e530dacdba936c22.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_e7ac49eabaef4294e530dacdba936c22.jpg not downloaded yet
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_6bc23b92f45ab81ae9fe748040f4b4a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_6bc23b92f45ab81ae9fe748040f4b4a6.jpg not downloaded yet
2026-03-27 20:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_18f01172707fd55fac081e6cc9c3d24d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_53967bf612dbe15b0ac3412dd30a2cc9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_6371a3b5d7610776f87fb03da4d05e56.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_6371a3b5d7610776f87fb03da4d05e56.jpg not downloaded yet
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_9938f91c08217d2e0b28bbf85253fac9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_9938f91c08217d2e0b28bbf85253fac9.jpg not downloaded yet
2026-03-27 20:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_dc35b43a29a18d78ee97e846d3a1d377.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_362e2327ee4c047bde671755376c404d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_6d1368c3eb9c003311270433423453ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_67ec0742b68e887eb1db6b9a450f7bb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_67ec0742b68e887eb1db6b9a450f7bb8.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_78bf3430815e230396adf1090f7c64a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_78bf3430815e230396adf1090f7c64a7.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_a3993156d7dd2b46b9de3a044a6e34ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_a3993156d7dd2b46b9de3a044a6e34ec.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_8d68cbd15de53694693bbed9e840bc8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_8d68cbd15de53694693bbed9e840bc8b.jpg not downloaded yet
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_9761e129ca1255aa8b0cffc988852add.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_323e65b0bc83e19f0256af68842a8e5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_323e65b0bc83e19f0256af68842a8e5b.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_1d6ca09f869cf76ad3bbd743631a794e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_1d6ca09f869cf76ad3bbd743631a794e.jpg not downloaded yet
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_b3e1d01e4319c2e7dc7ed06977423bd8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_a1de2a232191eb812c52f8a5f24b883e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_0900bcced8ed07f098afc54f5ec3d045.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_0900bcced8ed07f098afc54f5ec3d045.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_30066d9e6c722a9670242b4c8432ea73.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_30066d9e6c722a9670242b4c8432ea73.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_d6793372702d988e971f4edc0961d5eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_d6793372702d988e971f4edc0961d5eb.jpg not downloaded yet
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031d5e50>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_18f01172707fd55fac081e6cc9c3d24d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_18f01172707fd55fac081e6cc9c3d24d.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903db0f10>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_53967bf612dbe15b0ac3412dd30a2cc9.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_53967bf612dbe15b0ac3412dd30a2cc9.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_cf252446c0fb6584ca3129b3595e466a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_cf252446c0fb6584ca3129b3595e466a.jpg not downloaded yet
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF24104> (referer: https://www.auto1.com/v1/car-details-view/GF24104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_b31fa9802e4427179fd497fb55c28fb7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b31fa9802e4427179fd497fb55c28fb7.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_8724033e90fdad318581464a56d5dce5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_8724033e90fdad318581464a56d5dce5.jpg not downloaded yet
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033e0690>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_dc35b43a29a18d78ee97e846d3a1d377.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_dc35b43a29a18d78ee97e846d3a1d377.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9120cb310>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_362e2327ee4c047bde671755376c404d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_362e2327ee4c047bde671755376c404d.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903226490>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_6d1368c3eb9c003311270433423453ce.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_6d1368c3eb9c003311270433423453ce.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_df4d692a6c4687ae82b446d1b492d387.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_74213805b2841e5124c6d1956458f415.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_74213805b2841e5124c6d1956458f415.jpg not downloaded yet
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_27ae87f1b24999fbb7194cb1d4b3ad54.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_2343d7608a87cec15e216fd9cb5db3a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_2343d7608a87cec15e216fd9cb5db3a8.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_b9eae9de5297d6f801f1b704a71e9be1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_b9eae9de5297d6f801f1b704a71e9be1.jpg not downloaded yet
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_f4294178123d212d10f4cf4da9f1de4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_5b64fa43e42ee76ea4eda1e999983e62.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_5b64fa43e42ee76ea4eda1e999983e62.jpg not downloaded yet
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9f0d0>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_9761e129ca1255aa8b0cffc988852add.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_9761e129ca1255aa8b0cffc988852add.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fcc350>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_b3e1d01e4319c2e7dc7ed06977423bd8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_b3e1d01e4319c2e7dc7ed06977423bd8.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fcfc90>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_a1de2a232191eb812c52f8a5f24b883e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_a1de2a232191eb812c52f8a5f24b883e.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-27 20:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92561579-2897-5a8e-bbd2-8a9c08ff274a with scrape type 1
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_84e8ad82a107896f8fc6cdd5ba25426b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_84e8ad82a107896f8fc6cdd5ba25426b.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_4f2dd264007eee296f91efb95b887b81.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_4f2dd264007eee296f91efb95b887b81.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_0bf0ec69372baba9911f2085751807f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_0bf0ec69372baba9911f2085751807f5.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_737e557045eb8cca0b9a48651bf36d41.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_737e557045eb8cca0b9a48651bf36d41.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_b1894010fcf8fe5f71604894d024791f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b1894010fcf8fe5f71604894d024791f.jpg not downloaded yet
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_44f375b040412baea565e4553787d2a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_44f375b040412baea565e4553787d2a4.jpg not downloaded yet
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9030c5190>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_df4d692a6c4687ae82b446d1b492d387.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_df4d692a6c4687ae82b446d1b492d387.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e0a590>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_27ae87f1b24999fbb7194cb1d4b3ad54.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_27ae87f1b24999fbb7194cb1d4b3ad54.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c67410>
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_f4294178123d212d10f4cf4da9f1de4f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_f4294178123d212d10f4cf4da9f1de4f.jpg saved to cache
2026-03-27 20:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_6371a3b5d7610776f87fb03da4d05e56.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_7791c850a928d620c9d10c16289f4a72.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_7791c850a928d620c9d10c16289f4a72.jpg not downloaded yet
2026-03-27 20:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_cdc88632857050b7cc47f67ed81719a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_c5032637f2bb67b46f47cc4f5b2c9e3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_c5032637f2bb67b46f47cc4f5b2c9e3b.jpg not downloaded yet
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_3f5ad37e86a710e2684cbce1384ff9cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_3f5ad37e86a710e2684cbce1384ff9cc.jpg not downloaded yet
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_3eff3a879b23e22415e19a8f9d8df9f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_3eff3a879b23e22415e19a8f9d8df9f7.jpg not downloaded yet
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_36977d346241aa2f5bd892e1b97f9a6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_36977d346241aa2f5bd892e1b97f9a6d.jpg not downloaded yet
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_68a1decc14a13a220b0ee0bc641766c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_68a1decc14a13a220b0ee0bc641766c9.jpg not downloaded yet
2026-03-27 20:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_56cd363f08119c4504fbb298ccb69e4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_50d4a8519f87e0ab0e6e725929c7e2e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_50d4a8519f87e0ab0e6e725929c7e2e8.jpg not downloaded yet
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b4310>
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_6371a3b5d7610776f87fb03da4d05e56.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_6371a3b5d7610776f87fb03da4d05e56.jpg saved to cache
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_d44f94234c834c99745ccdf079cf1e5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_d44f94234c834c99745ccdf079cf1e5b.jpg not downloaded yet
2026-03-27 20:39:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e1e150>
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_cdc88632857050b7cc47f67ed81719a4.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_cdc88632857050b7cc47f67ed81719a4.jpg saved to cache
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_f16d2aaba8f4d338b399c7b5c7bab83d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_f16d2aaba8f4d338b399c7b5c7bab83d.jpg not downloaded yet
2026-03-27 20:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_323e65b0bc83e19f0256af68842a8e5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_989bd9a845cf84de2986e575095bbcba.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_989bd9a845cf84de2986e575095bbcba.jpg not downloaded yet
2026-03-27 20:39:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912627f50>
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fed%252F04eda508fccf793eef1cece803ff2e25%252Fpa%252FWW24606_56cd363f08119c4504fbb298ccb69e4c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_56cd363f08119c4504fbb298ccb69e4c.jpg saved to cache
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0961c7e7-aaaa-5e53-be76-b20506cee12e
2026-03-27 20:39:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0961c7e7-aaaa-5e53-be76-b20506cee12e, skipping ID generation
2026-03-27 20:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0961c7e7-aaaa-5e53-be76-b20506cee12e with scrape type 1
2026-03-27 20:39:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0961c7e7-aaaa-5e53-be76-b20506cee12e sending to next pipeline
2026-03-27 20:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0961c7e7-aaaa-5e53-be76-b20506cee12e, identifier: WW24606
2026-03-27 20:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0961c7e7-aaaa-5e53-be76-b20506cee12e with identifier: WW24606
2026-03-27 20:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0961c7e7-aaaa-5e53-be76-b20506cee12e with identifier: WW24606
2026-03-27 20:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0961c7e7-aaaa-5e53-be76-b20506cee12e with identifier: WW24606 to the API
2026-03-27 20:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_56cd363f08119c4504fbb298ccb69e4c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:48Z',
 'fuel_type': 'petrol',
 'id': '0961c7e7-aaaa-5e53-be76-b20506cee12e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW24606',
 'listing': 'auction',
 'location': 'BE, Aarschot',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 180003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_d05b8db9353910b8e4dc1d62f9d3b109.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_054cd9ef6fe2e13442a22f7b02a52b47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506348,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_405cd49e3700a5257556ced29b2d2ce7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600652,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_1b65a55c142138a8e7a34b67be5222d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2280110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_cdc88632857050b7cc47f67ed81719a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2341944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_faac03802df1c79a43a03bc1631b133d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2255262,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_c830b29956fbd004ba7061cffc393190.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_9d5b1186769c19056b447e8120a7181b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2474895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_02fe1b8512c2f82c1382dd7b9a14a4bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0961c7e7-aaaa-5e53-be76-b20506cee12e/0961c7e7-aaaa-5e53-be76-b20506cee12e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440813,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/ed/04eda508fccf793eef1cece803ff2e25/pa/WW24606_56cd363f08119c4504fbb298ccb69e4c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2010}
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW24606%27 HTTP/1.1" 200 None
2026-03-27 20:39:41 [auto1.be] INFO: Saving data for WW24606: {'created_time': 1774643981.153513, 'last_price_update_time': 1774643981.153523, 'auction_closing_time': 1774714188.0}
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW24606') HTTP/1.1" 204 0
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC59712> (referer: https://www.auto1.com/v1/car-details-view/SC59712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc2ed0>
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_323e65b0bc83e19f0256af68842a8e5b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_323e65b0bc83e19f0256af68842a8e5b.jpg saved to cache
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_181fbbf12145e52bef7799f833f625b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_e7ac49eabaef4294e530dacdba936c22.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_9938f91c08217d2e0b28bbf85253fac9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d17f3c754415b13352a8529574f9e7ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_a3993156d7dd2b46b9de3a044a6e34ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_1d6ca09f869cf76ad3bbd743631a794e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_6bc23b92f45ab81ae9fe748040f4b4a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-27 20:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a06debf-942b-59fe-aa39-cc2aa07606c9 with scrape type 1
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_d4f3b60d006c703809e10785d4215717.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_d4f3b60d006c703809e10785d4215717.jpg not downloaded yet
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_e31708e14ae6e84119c3dcb5df9f7cae.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_e31708e14ae6e84119c3dcb5df9f7cae.jpg not downloaded yet
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_aa32de4994e69a047d4c689c5e056800.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_aa32de4994e69a047d4c689c5e056800.jpg not downloaded yet
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_38deeb7bb9f1e91868d5c5507eac8870.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_38deeb7bb9f1e91868d5c5507eac8870.jpg not downloaded yet
2026-03-27 20:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903136fd0>
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_181fbbf12145e52bef7799f833f625b3.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_181fbbf12145e52bef7799f833f625b3.jpg saved to cache
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903254710>
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_e7ac49eabaef4294e530dacdba936c22.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_e7ac49eabaef4294e530dacdba936c22.jpg saved to cache
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903106f10>
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_9938f91c08217d2e0b28bbf85253fac9.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_9938f91c08217d2e0b28bbf85253fac9.jpg saved to cache
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032558d0>
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_d17f3c754415b13352a8529574f9e7ce.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d17f3c754415b13352a8529574f9e7ce.jpg saved to cache
2026-03-27 20:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d40dd0>
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_a3993156d7dd2b46b9de3a044a6e34ec.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_a3993156d7dd2b46b9de3a044a6e34ec.jpg saved to cache
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9b110>
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_1d6ca09f869cf76ad3bbd743631a794e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_1d6ca09f869cf76ad3bbd743631a794e.jpg saved to cache
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031bd850>
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_6bc23b92f45ab81ae9fe748040f4b4a6.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_6bc23b92f45ab81ae9fe748040f4b4a6.jpg saved to cache
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_323e7cba05e3e0393bc0ff53fe68cc0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_323e7cba05e3e0393bc0ff53fe68cc0e.jpg not downloaded yet
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_74213805b2841e5124c6d1956458f415.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_63e898b80c260b3056b0e2f2e23910e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_63e898b80c260b3056b0e2f2e23910e2.jpg not downloaded yet
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_bd98f01bcc5b0d53b1251212726214af.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_bd98f01bcc5b0d53b1251212726214af.jpg not downloaded yet
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_c331b27bcd233c984c0e2df1be6f0a1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_c331b27bcd233c984c0e2df1be6f0a1c.jpg not downloaded yet
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_d6793372702d988e971f4edc0961d5eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_b7a1bedf3231e6576018816e5caea37c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_b7a1bedf3231e6576018816e5caea37c.jpg not downloaded yet
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_46eb206c1f2babcf4ad9502a044b7e2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_46eb206c1f2babcf4ad9502a044b7e2e.jpg not downloaded yet
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ef5b10>
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_74213805b2841e5124c6d1956458f415.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_74213805b2841e5124c6d1956458f415.jpg saved to cache
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e0a890>
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_d6793372702d988e971f4edc0961d5eb.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_d6793372702d988e971f4edc0961d5eb.jpg saved to cache
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_44f375b040412baea565e4553787d2a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_8724033e90fdad318581464a56d5dce5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_f16d2aaba8f4d338b399c7b5c7bab83d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_68a1decc14a13a220b0ee0bc641766c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_737e557045eb8cca0b9a48651bf36d41.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_cf252446c0fb6584ca3129b3595e466a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_989bd9a845cf84de2986e575095bbcba.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_323e7cba05e3e0393bc0ff53fe68cc0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_aa32de4994e69a047d4c689c5e056800.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903026b90>
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_44f375b040412baea565e4553787d2a4.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_44f375b040412baea565e4553787d2a4.jpg saved to cache
2026-03-27 20:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_d4f3b60d006c703809e10785d4215717.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_e31708e14ae6e84119c3dcb5df9f7cae.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d052d0>
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_8724033e90fdad318581464a56d5dce5.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_8724033e90fdad318581464a56d5dce5.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd2890>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_f16d2aaba8f4d338b399c7b5c7bab83d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_f16d2aaba8f4d338b399c7b5c7bab83d.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903db2e10>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_68a1decc14a13a220b0ee0bc641766c9.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_68a1decc14a13a220b0ee0bc641766c9.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd2050>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_737e557045eb8cca0b9a48651bf36d41.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_737e557045eb8cca0b9a48651bf36d41.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031738d0>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_cf252446c0fb6584ca3129b3595e466a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_cf252446c0fb6584ca3129b3595e466a.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90305d850>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_989bd9a845cf84de2986e575095bbcba.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_989bd9a845cf84de2986e575095bbcba.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e08f50>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_323e7cba05e3e0393bc0ff53fe68cc0e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_323e7cba05e3e0393bc0ff53fe68cc0e.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903173190>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_aa32de4994e69a047d4c689c5e056800.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_aa32de4994e69a047d4c689c5e056800.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9120cb510>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_d4f3b60d006c703809e10785d4215717.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_d4f3b60d006c703809e10785d4215717.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e4710>
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_e31708e14ae6e84119c3dcb5df9f7cae.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_e31708e14ae6e84119c3dcb5df9f7cae.jpg saved to cache
2026-03-27 20:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_46eb206c1f2babcf4ad9502a044b7e2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_36977d346241aa2f5bd892e1b97f9a6d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_38deeb7bb9f1e91868d5c5507eac8870.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_50d4a8519f87e0ab0e6e725929c7e2e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_bd98f01bcc5b0d53b1251212726214af.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_c5032637f2bb67b46f47cc4f5b2c9e3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_c331b27bcd233c984c0e2df1be6f0a1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_63e898b80c260b3056b0e2f2e23910e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_b7a1bedf3231e6576018816e5caea37c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031ed310>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_46eb206c1f2babcf4ad9502a044b7e2e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_46eb206c1f2babcf4ad9502a044b7e2e.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b1894010fcf8fe5f71604894d024791f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_4f2dd264007eee296f91efb95b887b81.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032eb590>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_36977d346241aa2f5bd892e1b97f9a6d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_36977d346241aa2f5bd892e1b97f9a6d.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033b6590>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_38deeb7bb9f1e91868d5c5507eac8870.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_38deeb7bb9f1e91868d5c5507eac8870.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90317fdd0>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_50d4a8519f87e0ab0e6e725929c7e2e8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_50d4a8519f87e0ab0e6e725929c7e2e8.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033e7290>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_bd98f01bcc5b0d53b1251212726214af.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_bd98f01bcc5b0d53b1251212726214af.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c87390>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_c5032637f2bb67b46f47cc4f5b2c9e3b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_c5032637f2bb67b46f47cc4f5b2c9e3b.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c86c10>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_c331b27bcd233c984c0e2df1be6f0a1c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_c331b27bcd233c984c0e2df1be6f0a1c.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d1a850>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_63e898b80c260b3056b0e2f2e23910e2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_63e898b80c260b3056b0e2f2e23910e2.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033b73d0>
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd7%252F19d79fcd7e3e28c216d0b7bce07bdd76%252Fpa%252FSC59712_b7a1bedf3231e6576018816e5caea37c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_b7a1bedf3231e6576018816e5caea37c.jpg saved to cache
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a06debf-942b-59fe-aa39-cc2aa07606c9
2026-03-27 20:39:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a06debf-942b-59fe-aa39-cc2aa07606c9, skipping ID generation
2026-03-27 20:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a06debf-942b-59fe-aa39-cc2aa07606c9 with scrape type 1
2026-03-27 20:39:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a06debf-942b-59fe-aa39-cc2aa07606c9 sending to next pipeline
2026-03-27 20:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a06debf-942b-59fe-aa39-cc2aa07606c9, identifier: SC59712
2026-03-27 20:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-27 20:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712
2026-03-27 20:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a06debf-942b-59fe-aa39-cc2aa07606c9 with identifier: SC59712 to the API
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_b7a1bedf3231e6576018816e5caea37c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:12:09Z',
 'fuel_type': 'diesel',
 'id': '0a06debf-942b-59fe-aa39-cc2aa07606c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC59712',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 98451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_d4f3b60d006c703809e10785d4215717.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_e31708e14ae6e84119c3dcb5df9f7cae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470652,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_aa32de4994e69a047d4c689c5e056800.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2345723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_38deeb7bb9f1e91868d5c5507eac8870.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_323e7cba05e3e0393bc0ff53fe68cc0e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415483,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_63e898b80c260b3056b0e2f2e23910e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2299696,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_bd98f01bcc5b0d53b1251212726214af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_c331b27bcd233c984c0e2df1be6f0a1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_b7a1bedf3231e6576018816e5caea37c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a06debf-942b-59fe-aa39-cc2aa07606c9/0a06debf-942b-59fe-aa39-cc2aa07606c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d7/19d79fcd7e3e28c216d0b7bce07bdd76/pa/SC59712_46eb206c1f2babcf4ad9502a044b7e2e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 V6 Diesel R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2018}
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-27 20:39:45 [auto1.be] INFO: Saving data for SC59712: {'created_time': 1774643985.486813, 'last_price_update_time': 1774643985.486822, 'auction_closing_time': 1774714329.0}
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC59712') HTTP/1.1" 204 0
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b3550>
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_b1894010fcf8fe5f71604894d024791f.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b1894010fcf8fe5f71604894d024791f.jpg saved to cache
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903172850>
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_4f2dd264007eee296f91efb95b887b81.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_4f2dd264007eee296f91efb95b887b81.jpg saved to cache
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_d44f94234c834c99745ccdf079cf1e5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_3eff3a879b23e22415e19a8f9d8df9f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_3f5ad37e86a710e2684cbce1384ff9cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_7791c850a928d620c9d10c16289f4a72.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_0bf0ec69372baba9911f2085751807f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_84e8ad82a107896f8fc6cdd5ba25426b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_5b64fa43e42ee76ea4eda1e999983e62.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b31fa9802e4427179fd497fb55c28fb7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_2343d7608a87cec15e216fd9cb5db3a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_30066d9e6c722a9670242b4c8432ea73.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e67650>
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_d44f94234c834c99745ccdf079cf1e5b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_d44f94234c834c99745ccdf079cf1e5b.jpg saved to cache
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_78bf3430815e230396adf1090f7c64a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_67ec0742b68e887eb1db6b9a450f7bb8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_8d68cbd15de53694693bbed9e840bc8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9b0d0>
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_3eff3a879b23e22415e19a8f9d8df9f7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_3eff3a879b23e22415e19a8f9d8df9f7.jpg saved to cache
2026-03-27 20:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e83e50>
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_3f5ad37e86a710e2684cbce1384ff9cc.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_3f5ad37e86a710e2684cbce1384ff9cc.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031c98d0>
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_7791c850a928d620c9d10c16289f4a72.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_7791c850a928d620c9d10c16289f4a72.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e81950>
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_0bf0ec69372baba9911f2085751807f5.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_0bf0ec69372baba9911f2085751807f5.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903110290>
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F27%252F0627e2bca97fcb8c333dfd1ef71131f7%252Fpa%252FGF24104_84e8ad82a107896f8fc6cdd5ba25426b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_84e8ad82a107896f8fc6cdd5ba25426b.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92561579-2897-5a8e-bbd2-8a9c08ff274a
2026-03-27 20:39:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92561579-2897-5a8e-bbd2-8a9c08ff274a, skipping ID generation
2026-03-27 20:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92561579-2897-5a8e-bbd2-8a9c08ff274a with scrape type 1
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92561579-2897-5a8e-bbd2-8a9c08ff274a sending to next pipeline
2026-03-27 20:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 92561579-2897-5a8e-bbd2-8a9c08ff274a, identifier: GF24104
2026-03-27 20:39:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c86310>
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_5b64fa43e42ee76ea4eda1e999983e62.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_5b64fa43e42ee76ea4eda1e999983e62.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e6ccd0>
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_b31fa9802e4427179fd497fb55c28fb7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b31fa9802e4427179fd497fb55c28fb7.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033106d0>
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_2343d7608a87cec15e216fd9cb5db3a8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_2343d7608a87cec15e216fd9cb5db3a8.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903110610>
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_30066d9e6c722a9670242b4c8432ea73.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_30066d9e6c722a9670242b4c8432ea73.jpg saved to cache
2026-03-27 20:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-27 20:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104
2026-03-27 20:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 92561579-2897-5a8e-bbd2-8a9c08ff274a with identifier: GF24104 to the API
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_84e8ad82a107896f8fc6cdd5ba25426b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:50:30Z',
 'fuel_type': 'diesel',
 'id': '92561579-2897-5a8e-bbd2-8a9c08ff274a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF24104',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 186938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2466138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_84e8ad82a107896f8fc6cdd5ba25426b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500487,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_737e557045eb8cca0b9a48651bf36d41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2326390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_7791c850a928d620c9d10c16289f4a72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2298382,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_3eff3a879b23e22415e19a8f9d8df9f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2453976,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_36977d346241aa2f5bd892e1b97f9a6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_68a1decc14a13a220b0ee0bc641766c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2376030,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_50d4a8519f87e0ab0e6e725929c7e2e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2368565,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_d44f94234c834c99745ccdf079cf1e5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_f16d2aaba8f4d338b399c7b5c7bab83d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92561579-2897-5a8e-bbd2-8a9c08ff274a/92561579-2897-5a8e-bbd2-8a9c08ff274a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2623000,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/27/0627e2bca97fcb8c333dfd1ef71131f7/pa/GF24104_989bd9a845cf84de2986e575095bbcba.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-27 20:39:47 [auto1.be] INFO: Saving data for GF24104: {'created_time': 1774643987.368553, 'last_price_update_time': 1774643987.368568, 'auction_closing_time': 1774716630.0}
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF24104') HTTP/1.1" 204 0
2026-03-27 20:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_178e4ca33e6f54c2604867ae125fd24b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_b2909683a0940365c6a5316afea54d5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_e0830e5f7bb3765b21d3904591212eba.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911e83e50>
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F01%252F9d010ba72fbe08e5c8fd8c0d96414b29%252Fpa%252FVT14549_78bf3430815e230396adf1090f7c64a7.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_78bf3430815e230396adf1090f7c64a7.jpg saved to cache
2026-03-27 20:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2
2026-03-27 20:39:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90f6511d-037f-5bcc-886f-8fb3735bc0c2, skipping ID generation
2026-03-27 20:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2 with scrape type 1
2026-03-27 20:39:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90f6511d-037f-5bcc-886f-8fb3735bc0c2 sending to next pipeline
2026-03-27 20:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90f6511d-037f-5bcc-886f-8fb3735bc0c2, identifier: VT14549
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903010a50>
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_67ec0742b68e887eb1db6b9a450f7bb8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_67ec0742b68e887eb1db6b9a450f7bb8.jpg saved to cache
2026-03-27 20:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032c9810>
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_8d68cbd15de53694693bbed9e840bc8b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_8d68cbd15de53694693bbed9e840bc8b.jpg saved to cache
2026-03-27 20:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90f6511d-037f-5bcc-886f-8fb3735bc0c2 with identifier: VT14549
2026-03-27 20:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90f6511d-037f-5bcc-886f-8fb3735bc0c2 with identifier: VT14549
2026-03-27 20:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90f6511d-037f-5bcc-886f-8fb3735bc0c2 with identifier: VT14549 to the API
2026-03-27 20:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_78bf3430815e230396adf1090f7c64a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:37:37Z',
 'fuel_type': 'petrol',
 'id': '90f6511d-037f-5bcc-886f-8fb3735bc0c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT14549',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 15602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_f4294178123d212d10f4cf4da9f1de4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_6371a3b5d7610776f87fb03da4d05e56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_78bf3430815e230396adf1090f7c64a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_323e65b0bc83e19f0256af68842a8e5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_30066d9e6c722a9670242b4c8432ea73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b31fa9802e4427179fd497fb55c28fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_2343d7608a87cec15e216fd9cb5db3a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_4f2dd264007eee296f91efb95b887b81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_b1894010fcf8fe5f71604894d024791f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f6511d-037f-5bcc-886f-8fb3735bc0c2/90f6511d-037f-5bcc-886f-8fb3735bc0c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/01/9d010ba72fbe08e5c8fd8c0d96414b29/pa/VT14549_c5032637f2bb67b46f47cc4f5b2c9e3b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT14549%27 HTTP/1.1" 200 None
2026-03-27 20:39:48 [auto1.be] INFO: Saving data for VT14549: {'created_time': 1774643988.167929, 'last_price_update_time': 1774643988.167976, 'auction_closing_time': 1774715857.0}
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VT14549') HTTP/1.1" 204 0
2026-03-27 20:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_86ea9413bf4b3bed676be765cb1a5966.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_285b2cb4478233488a00444e6977421d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd2590>
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_178e4ca33e6f54c2604867ae125fd24b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_178e4ca33e6f54c2604867ae125fd24b.jpg saved to cache
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903de6f50>
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_b2909683a0940365c6a5316afea54d5b.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_b2909683a0940365c6a5316afea54d5b.jpg saved to cache
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f8d550>
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_e0830e5f7bb3765b21d3904591212eba.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_e0830e5f7bb3765b21d3904591212eba.jpg saved to cache
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_82ef7c9ba8488f7cb367ec5d67a8acbe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911e65190>
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F08%252F780802a22f7b8a6b00a9ef4cf73b63db%252Fpa%252FGS99704_86ea9413bf4b3bed676be765cb1a5966.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_86ea9413bf4b3bed676be765cb1a5966.jpg saved to cache
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b974b1b6-19de-5e7d-90b5-ef53ef835da4
2026-03-27 20:39:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b974b1b6-19de-5e7d-90b5-ef53ef835da4, skipping ID generation
2026-03-27 20:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b974b1b6-19de-5e7d-90b5-ef53ef835da4 with scrape type 1
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b974b1b6-19de-5e7d-90b5-ef53ef835da4 sending to next pipeline
2026-03-27 20:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b974b1b6-19de-5e7d-90b5-ef53ef835da4, identifier: GS99704
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031a5190>
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_285b2cb4478233488a00444e6977421d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_285b2cb4478233488a00444e6977421d.jpg saved to cache
2026-03-27 20:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-27 20:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704
2026-03-27 20:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b974b1b6-19de-5e7d-90b5-ef53ef835da4 with identifier: GS99704 to the API
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_86ea9413bf4b3bed676be765cb1a5966.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:50Z',
 'fuel_type': 'diesel',
 'id': 'b974b1b6-19de-5e7d-90b5-ef53ef835da4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS99704',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 161000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_86ea9413bf4b3bed676be765cb1a5966.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_df4d692a6c4687ae82b446d1b492d387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_a1de2a232191eb812c52f8a5f24b883e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_9761e129ca1255aa8b0cffc988852add.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_f3792232f4a900a096ef004b69ebc8ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_53967bf612dbe15b0ac3412dd30a2cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_6d1368c3eb9c003311270433423453ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_362e2327ee4c047bde671755376c404d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_dc35b43a29a18d78ee97e846d3a1d377.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b974b1b6-19de-5e7d-90b5-ef53ef835da4/b974b1b6-19de-5e7d-90b5-ef53ef835da4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/08/780802a22f7b8a6b00a9ef4cf73b63db/pa/GS99704_18f01172707fd55fac081e6cc9c3d24d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-27 20:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-27 20:39:49 [auto1.be] INFO: Saving data for GS99704: {'created_time': 1774643989.007071, 'last_price_update_time': 1774643989.007081, 'auction_closing_time': 1774714850.0}
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS99704') HTTP/1.1" 204 0
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90320bbd0>
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_82ef7c9ba8488f7cb367ec5d67a8acbe.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_82ef7c9ba8488f7cb367ec5d67a8acbe.jpg saved to cache
2026-03-27 20:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_b9eae9de5297d6f801f1b704a71e9be1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_0900bcced8ed07f098afc54f5ec3d045.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_fdb8dd6595c3b80b3c482676443cd016.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_4c076c73a237a92d4802c2e14c065ac2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_94bf66421eb31a61962938fe22fe2543.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_67a07e2f89e91524ae23bd2e8ebac256.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_2019c0a77c18a31c65067aa5e16a0c00.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_240f3176caed2148a187710fe8d95d97.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_be575a03318c384fbd5c66b4de14c5d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_51ceb6d5004a108eb11bf8db90eed35c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_5530f973f9beecb5f00e205e9318cc22.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e0a990>
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F6f%252Faf6f4690ff04a1820031d27f7c7a50de%252Fpa%252FXJ24324_b9eae9de5297d6f801f1b704a71e9be1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_b9eae9de5297d6f801f1b704a71e9be1.jpg saved to cache
2026-03-27 20:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681
2026-03-27 20:39:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd7687a2-24e4-51a2-b63d-23fe3f5e1681, skipping ID generation
2026-03-27 20:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with scrape type 1
2026-03-27 20:39:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd7687a2-24e4-51a2-b63d-23fe3f5e1681 sending to next pipeline
2026-03-27 20:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd7687a2-24e4-51a2-b63d-23fe3f5e1681, identifier: XJ24324
2026-03-27 20:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324
2026-03-27 20:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324
2026-03-27 20:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd7687a2-24e4-51a2-b63d-23fe3f5e1681 with identifier: XJ24324 to the API
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_b9eae9de5297d6f801f1b704a71e9be1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:35Z',
 'fuel_type': 'petrol',
 'id': 'fd7687a2-24e4-51a2-b63d-23fe3f5e1681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ24324',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 109455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2167806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_e7ac49eabaef4294e530dacdba936c22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2027534,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_9938f91c08217d2e0b28bbf85253fac9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2041150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_a3993156d7dd2b46b9de3a044a6e34ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1991589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_1d6ca09f869cf76ad3bbd743631a794e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2078213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_d6793372702d988e971f4edc0961d5eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2173807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_8724033e90fdad318581464a56d5dce5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2027297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_b9eae9de5297d6f801f1b704a71e9be1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2115249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_0bf0ec69372baba9911f2085751807f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2107480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_44f375b040412baea565e4553787d2a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd7687a2-24e4-51a2-b63d-23fe3f5e1681/fd7687a2-24e4-51a2-b63d-23fe3f5e1681_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2160745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/6f/af6f4690ff04a1820031d27f7c7a50de/pa/XJ24324_3f5ad37e86a710e2684cbce1384ff9cc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo ON Start/Stop',
 'transmission': 'automatic',
 'trim': 'ON Start/Stop',
 'year': 2017}
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-27 20:39:49 [auto1.be] INFO: Saving data for XJ24324: {'created_time': 1774643989.811715, 'last_price_update_time': 1774643989.811728, 'auction_closing_time': 1774713995.0}
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ24324') HTTP/1.1" 204 0
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_3ec0501b29bb4eb4fe85d53b520e850d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_756650509fae125b0415ce5a6c6926a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903de4850>
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Fc1%252Fa3c17dc18e8ee730e6a8235b71c98978%252Fpa%252FHP74170_0900bcced8ed07f098afc54f5ec3d045.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_0900bcced8ed07f098afc54f5ec3d045.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58d190d7-ae2b-59be-b179-cfe65922cfe0
2026-03-27 20:39:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58d190d7-ae2b-59be-b179-cfe65922cfe0, skipping ID generation
2026-03-27 20:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d190d7-ae2b-59be-b179-cfe65922cfe0 with scrape type 1
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58d190d7-ae2b-59be-b179-cfe65922cfe0 sending to next pipeline
2026-03-27 20:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58d190d7-ae2b-59be-b179-cfe65922cfe0, identifier: HP74170
2026-03-27 20:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903de4850>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_fdb8dd6595c3b80b3c482676443cd016.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_fdb8dd6595c3b80b3c482676443cd016.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce9b10>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_4c076c73a237a92d4802c2e14c065ac2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_4c076c73a237a92d4802c2e14c065ac2.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903198f10>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_94bf66421eb31a61962938fe22fe2543.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_94bf66421eb31a61962938fe22fe2543.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c99810>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_67a07e2f89e91524ae23bd2e8ebac256.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_67a07e2f89e91524ae23bd2e8ebac256.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c4b0d0>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_2019c0a77c18a31c65067aa5e16a0c00.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_2019c0a77c18a31c65067aa5e16a0c00.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90312e110>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_240f3176caed2148a187710fe8d95d97.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_240f3176caed2148a187710fe8d95d97.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce8d50>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_be575a03318c384fbd5c66b4de14c5d4.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_be575a03318c384fbd5c66b4de14c5d4.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c4b790>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_51ceb6d5004a108eb11bf8db90eed35c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_51ceb6d5004a108eb11bf8db90eed35c.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c98cd0>
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_5530f973f9beecb5f00e205e9318cc22.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_5530f973f9beecb5f00e205e9318cc22.jpg saved to cache
2026-03-27 20:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-27 20:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170
2026-03-27 20:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58d190d7-ae2b-59be-b179-cfe65922cfe0 with identifier: HP74170 to the API
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_0900bcced8ed07f098afc54f5ec3d045.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:36:10Z',
 'fuel_type': 'diesel',
 'id': '58d190d7-ae2b-59be-b179-cfe65922cfe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP74170',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 151930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389888,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_b3e1d01e4319c2e7dc7ed06977423bd8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_e0830e5f7bb3765b21d3904591212eba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370567,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_178e4ca33e6f54c2604867ae125fd24b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691162,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_6bc23b92f45ab81ae9fe748040f4b4a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_67ec0742b68e887eb1db6b9a450f7bb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_8d68cbd15de53694693bbed9e840bc8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_0900bcced8ed07f098afc54f5ec3d045.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_cf252446c0fb6584ca3129b3595e466a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_74213805b2841e5124c6d1956458f415.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d190d7-ae2b-59be-b179-cfe65922cfe0/58d190d7-ae2b-59be-b179-cfe65922cfe0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/c1/a3c17dc18e8ee730e6a8235b71c98978/pa/HP74170_5b64fa43e42ee76ea4eda1e999983e62.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-27 20:39:51 [auto1.be] INFO: Saving data for HP74170: {'created_time': 1774643991.307399, 'last_price_update_time': 1774643991.307411, 'auction_closing_time': 1774715770.0}
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP74170') HTTP/1.1" 204 0
2026-03-27 20:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce6c90>
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_3ec0501b29bb4eb4fe85d53b520e850d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_3ec0501b29bb4eb4fe85d53b520e850d.jpg saved to cache
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903295590>
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_756650509fae125b0415ce5a6c6926a1.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_756650509fae125b0415ce5a6c6926a1.jpg saved to cache
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_0ba875df50886a759f6179f4332b297a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_f6f78b8bd138f2cf30ecdf82f6e4e193.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_e7605c5ab813e9a034cb57892fa78f1a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d72d0fd0caa18b0eae3bf27b474dd1dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_b69b9baed31afe61fe0d7ae72432008e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_71ccea91b69cb78f4d1cadd60e07c71e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_a0605dd747887b0988819b30018a6a91.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031eb090>
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_0ba875df50886a759f6179f4332b297a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_0ba875df50886a759f6179f4332b297a.jpg saved to cache
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_dff62f0699a130075ab39e14edec3c2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_71723aacf1b0b4a833ab6b3e182d2efc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e7c50>
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_f6f78b8bd138f2cf30ecdf82f6e4e193.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_f6f78b8bd138f2cf30ecdf82f6e4e193.jpg saved to cache
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdc8d0>
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_e7605c5ab813e9a034cb57892fa78f1a.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_e7605c5ab813e9a034cb57892fa78f1a.jpg saved to cache
2026-03-27 20:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f3c90>
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_d72d0fd0caa18b0eae3bf27b474dd1dd.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d72d0fd0caa18b0eae3bf27b474dd1dd.jpg saved to cache
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903241210>
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_b69b9baed31afe61fe0d7ae72432008e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_b69b9baed31afe61fe0d7ae72432008e.jpg saved to cache
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e9fb90>
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_71ccea91b69cb78f4d1cadd60e07c71e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_71ccea91b69cb78f4d1cadd60e07c71e.jpg saved to cache
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032f3110>
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F02%252Fae028c73cd96e60af5e3f3b6789d0880%252Fpa%252FWG79733_a0605dd747887b0988819b30018a6a91.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_a0605dd747887b0988819b30018a6a91.jpg saved to cache
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd551289-d6dd-52aa-874e-0b2653eb537b
2026-03-27 20:39:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd551289-d6dd-52aa-874e-0b2653eb537b, skipping ID generation
2026-03-27 20:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd551289-d6dd-52aa-874e-0b2653eb537b with scrape type 1
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd551289-d6dd-52aa-874e-0b2653eb537b sending to next pipeline
2026-03-27 20:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd551289-d6dd-52aa-874e-0b2653eb537b, identifier: WG79733
2026-03-27 20:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd551289-d6dd-52aa-874e-0b2653eb537b with identifier: WG79733
2026-03-27 20:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd551289-d6dd-52aa-874e-0b2653eb537b with identifier: WG79733
2026-03-27 20:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd551289-d6dd-52aa-874e-0b2653eb537b with identifier: WG79733 to the API
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_a0605dd747887b0988819b30018a6a91.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:49:12Z',
 'fuel_type': 'diesel',
 'id': 'cd551289-d6dd-52aa-874e-0b2653eb537b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG79733',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 138008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_a0605dd747887b0988819b30018a6a91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_aa27467feb410d3f2b6e4dbf0ec1ffb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_25e890945272251b0544d60f43da8957.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_4b44afe3083185d5888c9f1ec1473210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_c8022fab776ef7c48433fcef2994e925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd551289-d6dd-52aa-874e-0b2653eb537b/cd551289-d6dd-52aa-874e-0b2653eb537b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/02/ae028c73cd96e60af5e3f3b6789d0880/pa/WG79733_fb276dfadd8a208811a5ac91c1b59c42.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2008}
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG79733%27 HTTP/1.1" 200 None
2026-03-27 20:39:52 [auto1.be] INFO: Saving data for WG79733: {'created_time': 1774643992.738214, 'last_price_update_time': 1774643992.738226, 'auction_closing_time': 1774716552.0}
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG79733') HTTP/1.1" 204 0
2026-03-27 20:39:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903110210>
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_dff62f0699a130075ab39e14edec3c2c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_dff62f0699a130075ab39e14edec3c2c.jpg saved to cache
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90303d950>
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9a%252F749a730e869c9ec61001bf28797ac5b4%252Fpa%252FWF72066_71723aacf1b0b4a833ab6b3e182d2efc.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_71723aacf1b0b4a833ab6b3e182d2efc.jpg saved to cache
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1686fde-c240-5912-a1f3-b1a8ca870b08
2026-03-27 20:39:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1686fde-c240-5912-a1f3-b1a8ca870b08, skipping ID generation
2026-03-27 20:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1686fde-c240-5912-a1f3-b1a8ca870b08 with scrape type 1
2026-03-27 20:39:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1686fde-c240-5912-a1f3-b1a8ca870b08 sending to next pipeline
2026-03-27 20:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1686fde-c240-5912-a1f3-b1a8ca870b08, identifier: WF72066
2026-03-27 20:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1686fde-c240-5912-a1f3-b1a8ca870b08 with identifier: WF72066
2026-03-27 20:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1686fde-c240-5912-a1f3-b1a8ca870b08 with identifier: WF72066
2026-03-27 20:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1686fde-c240-5912-a1f3-b1a8ca870b08 with identifier: WF72066 to the API
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_71723aacf1b0b4a833ab6b3e182d2efc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:47:58Z',
 'fuel_type': 'diesel',
 'id': 'a1686fde-c240-5912-a1f3-b1a8ca870b08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF72066',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'BMW',
 'model': '3er',
 'odometer': 256801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341544,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_71723aacf1b0b4a833ab6b3e182d2efc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348361,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_dff62f0699a130075ab39e14edec3c2c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_756650509fae125b0415ce5a6c6926a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349422,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_5530f973f9beecb5f00e205e9318cc22.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_4fd4b26b9f1113e9737600bb6d2e169f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_51ceb6d5004a108eb11bf8db90eed35c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_82ef7c9ba8488f7cb367ec5d67a8acbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_285b2cb4478233488a00444e6977421d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_b2909683a0940365c6a5316afea54d5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1686fde-c240-5912-a1f3-b1a8ca870b08/a1686fde-c240-5912-a1f3-b1a8ca870b08_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297107,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9a/749a730e869c9ec61001bf28797ac5b4/pa/WF72066_27ae87f1b24999fbb7194cb1d4b3ad54.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF72066%27 HTTP/1.1" 200 None
2026-03-27 20:39:53 [auto1.be] INFO: Saving data for WF72066: {'created_time': 1774643993.396091, 'last_price_update_time': 1774643993.396102, 'auction_closing_time': 1774716478.0}
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WF72066') HTTP/1.1" 204 0
2026-03-27 20:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_7cdb931582e33ee54b11dbd8682fc417.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_5b433caf60459fccd14114472e3db83c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_050cbd9774c94b4d70d8dbd15d8676b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_94c80a82c881d06dd2725b91d54d5577.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f972462c47d52d85c2d4a7acb96eb3d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_57f1ca1a5b768bfc1bbabf76a3fd2911.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_2c4b000f5bd6e35a1654d0f123032d1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903136110>
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_7cdb931582e33ee54b11dbd8682fc417.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_7cdb931582e33ee54b11dbd8682fc417.jpg saved to cache
2026-03-27 20:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU40891> (referer: https://www.auto1.com/v1/car-details-view/ZU40891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ47299> (referer: https://www.auto1.com/v1/car-details-view/ZJ47299/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90323fad0>
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F24%252F9324b1f1437d6b980950ee8098b138e3%252Fpa%252FGB76910_5b433caf60459fccd14114472e3db83c.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_5b433caf60459fccd14114472e3db83c.jpg saved to cache
2026-03-27 20:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da
2026-03-27 20:39:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b7e4404-55e6-57b8-a03b-06eb7c80d1da, skipping ID generation
2026-03-27 20:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da with scrape type 1
2026-03-27 20:39:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b7e4404-55e6-57b8-a03b-06eb7c80d1da sending to next pipeline
2026-03-27 20:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7b7e4404-55e6-57b8-a03b-06eb7c80d1da, identifier: GB76910
2026-03-27 20:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903026190>
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_050cbd9774c94b4d70d8dbd15d8676b4.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_050cbd9774c94b4d70d8dbd15d8676b4.jpg saved to cache
2026-03-27 20:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90305f610>
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Faa%252Fa2aa798fc2f78afb6f5c8762cf89201a%252Fpa%252FGH94733_94c80a82c881d06dd2725b91d54d5577.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_94c80a82c881d06dd2725b91d54d5577.jpg saved to cache
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aad6bd01-d645-535d-aa6f-8b8f1581696b
2026-03-27 20:39:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aad6bd01-d645-535d-aa6f-8b8f1581696b, skipping ID generation
2026-03-27 20:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad6bd01-d645-535d-aa6f-8b8f1581696b with scrape type 1
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aad6bd01-d645-535d-aa6f-8b8f1581696b sending to next pipeline
2026-03-27 20:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aad6bd01-d645-535d-aa6f-8b8f1581696b, identifier: GH94733
2026-03-27 20:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90318cb50>
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F37%252F6137f4d2fa6689e46ac47b41cdec940f%252Fpa%252FVZ78935_f972462c47d52d85c2d4a7acb96eb3d2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f972462c47d52d85c2d4a7acb96eb3d2.jpg saved to cache
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69
2026-03-27 20:39:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efb2f53c-6290-5dbe-95bc-2bb7b214bc69, skipping ID generation
2026-03-27 20:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with scrape type 1
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efb2f53c-6290-5dbe-95bc-2bb7b214bc69 sending to next pipeline
2026-03-27 20:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb2f53c-6290-5dbe-95bc-2bb7b214bc69, identifier: VZ78935
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e57d0>
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_57f1ca1a5b768bfc1bbabf76a3fd2911.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_57f1ca1a5b768bfc1bbabf76a3fd2911.jpg saved to cache
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ed8410>
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_2c4b000f5bd6e35a1654d0f123032d1e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_2c4b000f5bd6e35a1654d0f123032d1e.jpg saved to cache
2026-03-27 20:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7b7e4404-55e6-57b8-a03b-06eb7c80d1da with identifier: GB76910
2026-03-27 20:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7b7e4404-55e6-57b8-a03b-06eb7c80d1da with identifier: GB76910
2026-03-27 20:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7b7e4404-55e6-57b8-a03b-06eb7c80d1da with identifier: GB76910 to the API
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_5b433caf60459fccd14114472e3db83c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:42Z',
 'fuel_type': 'diesel',
 'id': '7b7e4404-55e6-57b8-a03b-06eb7c80d1da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB76910',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 168489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_5b433caf60459fccd14114472e3db83c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_71ccea91b69cb78f4d1cadd60e07c71e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_e7605c5ab813e9a034cb57892fa78f1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_240f3176caed2148a187710fe8d95d97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2210651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_0ba875df50886a759f6179f4332b297a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_be575a03318c384fbd5c66b4de14c5d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_67a07e2f89e91524ae23bd2e8ebac256.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2274525,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_fdb8dd6595c3b80b3c482676443cd016.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2373700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_94bf66421eb31a61962938fe22fe2543.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b7e4404-55e6-57b8-a03b-06eb7c80d1da/7b7e4404-55e6-57b8-a03b-06eb7c80d1da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2265779,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/24/9324b1f1437d6b980950ee8098b138e3/pa/GB76910_181fbbf12145e52bef7799f833f625b3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Affaires Pack Clim Plus Start/Stop',
 'transmission': 'manual',
 'trim': 'Affaires Pack Clim Plus Start/Stop',
 'year': 2017}
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB76910%27 HTTP/1.1" 200 None
2026-03-27 20:39:54 [auto1.be] INFO: Saving data for GB76910: {'created_time': 1774643994.835001, 'last_price_update_time': 1774643994.835015, 'auction_closing_time': 1774714842.0}
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB76910') HTTP/1.1" 204 0
2026-03-27 20:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-27 20:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733
2026-03-27 20:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aad6bd01-d645-535d-aa6f-8b8f1581696b with identifier: GH94733 to the API
2026-03-27 20:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_94c80a82c881d06dd2725b91d54d5577.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:22:09Z',
 'fuel_type': 'petrol',
 'id': 'aad6bd01-d645-535d-aa6f-8b8f1581696b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH94733',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 77344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_94c80a82c881d06dd2725b91d54d5577.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_050cbd9774c94b4d70d8dbd15d8676b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596597,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_7cdb931582e33ee54b11dbd8682fc417.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_b69b9baed31afe61fe0d7ae72432008e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_f6f78b8bd138f2cf30ecdf82f6e4e193.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d72d0fd0caa18b0eae3bf27b474dd1dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2302250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_2019c0a77c18a31c65067aa5e16a0c00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2143863,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_3ec0501b29bb4eb4fe85d53b520e850d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2260806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_4c076c73a237a92d4802c2e14c065ac2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aad6bd01-d645-535d-aa6f-8b8f1581696b/aad6bd01-d645-535d-aa6f-8b8f1581696b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2601385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/aa/a2aa798fc2f78afb6f5c8762cf89201a/pa/GH94733_d17f3c754415b13352a8529574f9e7ce.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.4 Young',
 'transmission': 'manual',
 'trim': 'Young',
 'year': 2015}
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Saving data for GH94733: {'created_time': 1774643995.188131, 'last_price_update_time': 1774643995.188141, 'auction_closing_time': 1774714929.0}
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH94733') HTTP/1.1" 204 0
2026-03-27 20:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-27 20:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935
2026-03-27 20:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb2f53c-6290-5dbe-95bc-2bb7b214bc69 with identifier: VZ78935 to the API
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f972462c47d52d85c2d4a7acb96eb3d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:03Z',
 'fuel_type': 'diesel',
 'id': 'efb2f53c-6290-5dbe-95bc-2bb7b214bc69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ78935',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 277915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3411482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f972462c47d52d85c2d4a7acb96eb3d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3461183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_6ba2e53a5f1cbd9a3c729bbad4cb18b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3118779,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d5f889c65ee17ab495cb2817c27a9819.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3295042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0a421d2ea0debbda3249c8862d564379.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3319115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_e4e42bd61333ab18734fd46436c10618.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3083291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_d087a6eb642c6055e41ede0d6fae4d9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3253257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_59de57b46656757c294d5499d26c4ff3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3256654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_f94d87829adb66826647b33b0862ba9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3550996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_0ca18c313e56899c0321ac532f589eb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb2f53c-6290-5dbe-95bc-2bb7b214bc69/efb2f53c-6290-5dbe-95bc-2bb7b214bc69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641178,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/37/6137f4d2fa6689e46ac47b41cdec940f/pa/VZ78935_66cdc61b481b19bcd0aa8f15b9fe393b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
 'transmission': 'automatic',
 'trim': 'clean diesel',
 'year': 2015}
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Saving data for VZ78935: {'created_time': 1774643995.53797, 'last_price_update_time': 1774643995.53798, 'auction_closing_time': 1774714683.0}
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ78935') HTTP/1.1" 204 0
2026-03-27 20:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP17871> (referer: https://www.auto1.com/v1/car-details-view/SP17871/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA13965> (referer: https://www.auto1.com/v1/car-details-view/MA13965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS46918> (referer: https://www.auto1.com/v1/car-details-view/RS46918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f33e01-cff8-577f-bd44-766fb6a324f1 with identifier: ZU40891
2026-03-27 20:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f33e01-cff8-577f-bd44-766fb6a324f1 with scrape type 1
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_ad4ca8cba61e8c35cfbe206b3f1e1b9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_ad4ca8cba61e8c35cfbe206b3f1e1b9a.jpg not downloaded yet
2026-03-27 20:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-27 20:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8b03b22-9027-5a94-8b1f-e3d7022a458c with scrape type 1
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_8fb81f5add4e85cf282c293a50e5c736.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_8fb81f5add4e85cf282c293a50e5c736.jpg not downloaded yet
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_d38d7367d23a0d74340064ac6691ddb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_d38d7367d23a0d74340064ac6691ddb5.jpg not downloaded yet
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_9f7b9a316b91edeee0afc98c734a9f13.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_9f7b9a316b91edeee0afc98c734a9f13.jpg not downloaded yet
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_7e3d2b71c0950d9c467b959996b0ce38.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_7e3d2b71c0950d9c467b959996b0ce38.jpg not downloaded yet
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_871a33cdf216250fce6bfeba11b0be34.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_871a33cdf216250fce6bfeba11b0be34.jpg not downloaded yet
2026-03-27 20:39:55 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1659 | hits on page: 40
2026-03-27 20:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bad21a3-999a-53ff-b098-0a17cae18891 with identifier: SP17871
2026-03-27 20:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bad21a3-999a-53ff-b098-0a17cae18891 with scrape type 1
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_bc818e7baa3cc4a46ffe672af0907241.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_bc818e7baa3cc4a46ffe672af0907241.jpg not downloaded yet
2026-03-27 20:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe with identifier: MA13965
2026-03-27 20:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe with scrape type 1
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_943af61fa082e6c29e3ae2e21a00b59c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_943af61fa082e6c29e3ae2e21a00b59c.jpg not downloaded yet
2026-03-27 20:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-27 20:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with scrape type 1
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_1b4abe4d78e2b23ebc150b43645978c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_1b4abe4d78e2b23ebc150b43645978c8.jpg not downloaded yet
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_aff4b9025779717412492fbc91ca1794.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_aff4b9025779717412492fbc91ca1794.jpg not downloaded yet
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_c4801ce33e75b71e2af7524987a9da44.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_c4801ce33e75b71e2af7524987a9da44.jpg not downloaded yet
2026-03-27 20:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_5dbf0149370854213fe803cdf8d63999.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Scrape type for DL37030: 0
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-27 20:39:55 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-27 20:39:55 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU79691%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for BU79691: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-27 20:39:56 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_eae44534c11bf06602ff795454a0e378.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_eae44534c11bf06602ff795454a0e378.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_ab1b82fe9bc39225ef5f58cc54b157fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_ab1b82fe9bc39225ef5f58cc54b157fe.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_4ce8d83810b27797728616c44b314016.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_4ce8d83810b27797728616c44b314016.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_8cc9ed557938eb651d01b3ce352b2276.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_8cc9ed557938eb651d01b3ce352b2276.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_6a113ab86de877df5c1385375731c40c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_6a113ab86de877df5c1385375731c40c.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_7bfd39b8724006433f0980375d4b5298.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_7bfd39b8724006433f0980375d4b5298.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_e3d28ef461ea2af799c068538f1de4e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_e3d28ef461ea2af799c068538f1de4e2.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_27dc4917a1ebabad3759c833474c1dd9.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_27dc4917a1ebabad3759c833474c1dd9.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_50061edbd829901f96092941f192628a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_50061edbd829901f96092941f192628a.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_76f728f4e80b3a9c9c57b9b4fbb92cec.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_76f728f4e80b3a9c9c57b9b4fbb92cec.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_038778986a0e1d76219f9b22c201d70d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_038778986a0e1d76219f9b22c201d70d.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_f38dcbff4b44bf28f0b645ad2ab1b504.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_f38dcbff4b44bf28f0b645ad2ab1b504.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_a15de9f83e8ebb6647b2a69c60b9895a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a15de9f83e8ebb6647b2a69c60b9895a.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_5155fc569bca5e462104b2034427fdcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_5155fc569bca5e462104b2034427fdcb.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_81641d84e336d5266f18edd535d73650.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_81641d84e336d5266f18edd535d73650.jpg not downloaded yet
2026-03-27 20:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e7f90>
2026-03-27 20:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_5dbf0149370854213fe803cdf8d63999.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_5dbf0149370854213fe803cdf8d63999.jpg saved to cache
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_5747ab5715aaff0e78ed2ccb6c84977b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_5747ab5715aaff0e78ed2ccb6c84977b.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_3d37cdb939448363a6309caab5779764.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_3d37cdb939448363a6309caab5779764.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_a9c5e1e68a33783f4f4f17cfb78e102f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a9c5e1e68a33783f4f4f17cfb78e102f.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_58008e4e12854a44771bdd3ab8e83cda.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_58008e4e12854a44771bdd3ab8e83cda.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_890851416cf94edca17c5254b0ece809.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_890851416cf94edca17c5254b0ece809.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_e898c7dfccf8b3746937827a4c176b09.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e898c7dfccf8b3746937827a4c176b09.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_a48c80508ebe23ca1931299172a48cb6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_a48c80508ebe23ca1931299172a48cb6.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_29c3bfc86863bace56b1d74acbe3a6d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_29c3bfc86863bace56b1d74acbe3a6d2.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_f91aeffb4681e7c27d65189157318e3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_f91aeffb4681e7c27d65189157318e3e.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_d544c2706cac9a7110faf588f7079fd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_d544c2706cac9a7110faf588f7079fd2.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_04b1c80feb79de62069f175d1104109f.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_04b1c80feb79de62069f175d1104109f.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_f5641c8abd767c127211f1eb9c59891c.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_f5641c8abd767c127211f1eb9c59891c.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_1eea4c52632e53a14c3a6e5a133a9fb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_1eea4c52632e53a14c3a6e5a133a9fb4.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_4ce7a44f2985c80641b07f47c6b13117.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_4ce7a44f2985c80641b07f47c6b13117.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_f92e66c99673f55151e6e8da04e06417.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_f92e66c99673f55151e6e8da04e06417.jpg not downloaded yet
2026-03-27 20:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_99903551391ba36efc18b3569bb330f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_99903551391ba36efc18b3569bb330f8.jpg not downloaded yet
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_e5f1750aed1f83951103c6d50a8abae1.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e5f1750aed1f83951103c6d50a8abae1.jpg not downloaded yet
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_3b886b3f0145a578ad32bf3905e6c088.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_3b886b3f0145a578ad32bf3905e6c088.jpg not downloaded yet
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_c93ba95dba5d9c9c05a830dd95ae3442.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_c93ba95dba5d9c9c05a830dd95ae3442.jpg not downloaded yet
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_be77484ce314ff1885e25223e0425a5e.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_be77484ce314ff1885e25223e0425a5e.jpg not downloaded yet
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_8cecd220e8a5a748c223f9124d8503de.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_d7212f62dd8e6721201f1e66aec9d848.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_061af275a31c19a034eddf8d833687a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_0a069f4000aa8ab188b0ca225be64f24.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_50b18ee04794bec454fd8827bd32e825.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_3c68e10f53a2aeaa2020b58750ae721d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_bd0a4645968f55416e76a3f044cd6194.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d02346c6cb125ca94425468ecde7e1fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0ddb4fcd3be208d41d4e0e2aa9fd1285.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_1b4abe4d78e2b23ebc150b43645978c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fffa50>
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_8cecd220e8a5a748c223f9124d8503de.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_8cecd220e8a5a748c223f9124d8503de.jpg saved to cache
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_be77484ce314ff1885e25223e0425a5e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_bf4b4dc43dba3331c86035be297a15b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ63338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903136a10>
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F96%252Fe696e117394e3431bebf1680f4bf542b%252Fpa%252FUF59925_d7212f62dd8e6721201f1e66aec9d848.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_d7212f62dd8e6721201f1e66aec9d848.jpg saved to cache
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb397cae-cd70-5757-9a4a-4f90035e4674
2026-03-27 20:39:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb397cae-cd70-5757-9a4a-4f90035e4674, skipping ID generation
2026-03-27 20:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb397cae-cd70-5757-9a4a-4f90035e4674 with scrape type 1
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb397cae-cd70-5757-9a4a-4f90035e4674 sending to next pipeline
2026-03-27 20:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb397cae-cd70-5757-9a4a-4f90035e4674, identifier: UF59925
2026-03-27 20:39:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c6d050>
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4e%252F7d4e7e5cfa9c97aeae8aa6400763081b%252Fpa%252FTR55859_061af275a31c19a034eddf8d833687a0.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_061af275a31c19a034eddf8d833687a0.jpg saved to cache
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 990d78d7-5d5a-5d10-b077-858e767abc16
2026-03-27 20:39:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 990d78d7-5d5a-5d10-b077-858e767abc16, skipping ID generation
2026-03-27 20:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990d78d7-5d5a-5d10-b077-858e767abc16 with scrape type 1
2026-03-27 20:39:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 990d78d7-5d5a-5d10-b077-858e767abc16 sending to next pipeline
2026-03-27 20:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 990d78d7-5d5a-5d10-b077-858e767abc16, identifier: TR55859
2026-03-27 20:39:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f7b90>
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_0a069f4000aa8ab188b0ca225be64f24.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_0a069f4000aa8ab188b0ca225be64f24.jpg saved to cache
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031b5490>
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F96%252Feb962cbaca3ccd595e1418e10f558189%252Fpa%252FMG12074_50b18ee04794bec454fd8827bd32e825.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_50b18ee04794bec454fd8827bd32e825.jpg saved to cache
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 233a848e-6c23-55cb-beeb-a529abb7e4c5
2026-03-27 20:39:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 233a848e-6c23-55cb-beeb-a529abb7e4c5, skipping ID generation
2026-03-27 20:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233a848e-6c23-55cb-beeb-a529abb7e4c5 with scrape type 1
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 233a848e-6c23-55cb-beeb-a529abb7e4c5 sending to next pipeline
2026-03-27 20:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 233a848e-6c23-55cb-beeb-a529abb7e4c5, identifier: MG12074
2026-03-27 20:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90318fe50>
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_3c68e10f53a2aeaa2020b58750ae721d.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_3c68e10f53a2aeaa2020b58750ae721d.jpg saved to cache
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903164290>
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_bd0a4645968f55416e76a3f044cd6194.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_bd0a4645968f55416e76a3f044cd6194.jpg saved to cache
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90317f790>
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_d02346c6cb125ca94425468ecde7e1fb.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d02346c6cb125ca94425468ecde7e1fb.jpg saved to cache
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c97790>
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_0ddb4fcd3be208d41d4e0e2aa9fd1285.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0ddb4fcd3be208d41d4e0e2aa9fd1285.jpg saved to cache
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ff1690>
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_1b4abe4d78e2b23ebc150b43645978c8.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_1b4abe4d78e2b23ebc150b43645978c8.jpg saved to cache
2026-03-27 20:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-27 20:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925
2026-03-27 20:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb397cae-cd70-5757-9a4a-4f90035e4674 with identifier: UF59925 to the API
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_d7212f62dd8e6721201f1e66aec9d848.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:27:38Z',
 'fuel_type': 'diesel',
 'id': 'bb397cae-cd70-5757-9a4a-4f90035e4674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF59925',
 'listing': 'auction',
 'location': 'BE, Strépy Bracquegnies (La Louviere)',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 120472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670662,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_d7212f62dd8e6721201f1e66aec9d848.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_dcca55fc74ed5b55028fe36e40e078d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_853afa9ebccd909202d8c8476fb3d50c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594648,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_b2998987ca07d017344aa21cb4a623af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770796,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_a963916f27da309e777b2c29da99c20d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2774141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_2fccceae103f5a53583a684543fd605d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2811989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_9bf01e58acb7917f2e9e384074c96e0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_96192cdcd811161b8f9e304a95fad967.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_4f9460e0e9805839b3e024964c4cde39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb397cae-cd70-5757-9a4a-4f90035e4674/bb397cae-cd70-5757-9a4a-4f90035e4674_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/96/e696e117394e3431bebf1680f4bf542b/pa/UF59925_009ab14a5457ae4d5415c81c327a712c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-27 20:39:59 [auto1.be] INFO: Saving data for UF59925: {'created_time': 1774643999.091058, 'last_price_update_time': 1774643999.091069, 'auction_closing_time': 1774715258.0}
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF59925') HTTP/1.1" 204 0
2026-03-27 20:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 990d78d7-5d5a-5d10-b077-858e767abc16 with identifier: TR55859
2026-03-27 20:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 990d78d7-5d5a-5d10-b077-858e767abc16 with identifier: TR55859
2026-03-27 20:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 990d78d7-5d5a-5d10-b077-858e767abc16 with identifier: TR55859 to the API
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_061af275a31c19a034eddf8d833687a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:22:46Z',
 'fuel_type': 'petrol',
 'id': '990d78d7-5d5a-5d10-b077-858e767abc16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR55859',
 'listing': 'auction',
 'location': 'BE, Sint-Truiden',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 109886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_f65f16da8797ffc296d1cb52e9b522fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_0c5893374db1b8e7a860a851e17d2d07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3132394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_08d33287345aeab89cac3a6aa4e3eaa9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_acb087971cc7e615b9effd9a66b527ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002816,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_061af275a31c19a034eddf8d833687a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_8cecd220e8a5a748c223f9124d8503de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610147,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_b0807f148ada3af21adb66299c872e97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_c3c52b2d750f71652f2b6e53eaf7109f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_9d3653e13539d8890649c4cd57ac0cc1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990d78d7-5d5a-5d10-b077-858e767abc16/990d78d7-5d5a-5d10-b077-858e767abc16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682664,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4e/7d4e7e5cfa9c97aeae8aa6400763081b/pa/TR55859_6b5f27edd363030348d00978b6d218a1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mazda MX-5 1.5 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2016}
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR55859%27 HTTP/1.1" 200 None
2026-03-27 20:39:59 [auto1.be] INFO: Saving data for TR55859: {'created_time': 1774643999.503311, 'last_price_update_time': 1774643999.503323, 'auction_closing_time': 1774714966.0}
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TR55859') HTTP/1.1" 204 0
2026-03-27 20:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-27 20:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074
2026-03-27 20:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 233a848e-6c23-55cb-beeb-a529abb7e4c5 with identifier: MG12074 to the API
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_50b18ee04794bec454fd8827bd32e825.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:40Z',
 'fuel_type': 'diesel',
 'id': '233a848e-6c23-55cb-beeb-a529abb7e4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG12074',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 181544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3605008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_50b18ee04794bec454fd8827bd32e825.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3496359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_7d15f8b3cef647c0519e95e9627bae65.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3443182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_24c8290e4d796e4b6848b3d95a871579.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3269298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_e35e68985223d816f8036d8684bf4b98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3543305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_ea81ec18d5dfa8938d23e996bf42bc2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3578805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_d7f63c3dd55a6c673013ccb799875d1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3167932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_387602c34c2f207d6155402f13344b9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3489121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_16044b01fc204635625a6d7824190514.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3456170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_0d8888441ae0a8077046d5614d738520.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_233a848e-6c23-55cb-beeb-a529abb7e4c5/233a848e-6c23-55cb-beeb-a529abb7e4c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3098397,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/96/eb962cbaca3ccd595e1418e10f558189/pa/MG12074_1615655fabfc9427d3d7fe7ced310651.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-27 20:39:59 [auto1.be] INFO: Saving data for MG12074: {'created_time': 1774643999.891409, 'last_price_update_time': 1774643999.89142, 'auction_closing_time': 1774714360.0}
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG12074') HTTP/1.1" 204 0
2026-03-27 20:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV25434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032d8a90>
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_be77484ce314ff1885e25223e0425a5e.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_be77484ce314ff1885e25223e0425a5e.jpg saved to cache
2026-03-27 20:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903203a90>
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_bf4b4dc43dba3331c86035be297a15b2.jpg') HTTP/1.1" 204 0
2026-03-27 20:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_bf4b4dc43dba3331c86035be297a15b2.jpg saved to cache
2026-03-27 20:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_f22b8086a9ce06ba15597589f9e392bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d095322f1a77d40a2189120ef9c2fd91.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_af79c5c5160699848e5b7838c75eda2a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_3b886b3f0145a578ad32bf3905e6c088.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_c93ba95dba5d9c9c05a830dd95ae3442.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_f92e66c99673f55151e6e8da04e06417.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e5f1750aed1f83951103c6d50a8abae1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_99903551391ba36efc18b3569bb330f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_f5641c8abd767c127211f1eb9c59891c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_1eea4c52632e53a14c3a6e5a133a9fb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_f91aeffb4681e7c27d65189157318e3e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_04b1c80feb79de62069f175d1104109f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903de5790>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_f22b8086a9ce06ba15597589f9e392bc.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_f22b8086a9ce06ba15597589f9e392bc.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_29c3bfc86863bace56b1d74acbe3a6d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031bf950>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_d095322f1a77d40a2189120ef9c2fd91.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d095322f1a77d40a2189120ef9c2fd91.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_d544c2706cac9a7110faf588f7079fd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e6f50>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_af79c5c5160699848e5b7838c75eda2a.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_af79c5c5160699848e5b7838c75eda2a.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033b7090>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_3b886b3f0145a578ad32bf3905e6c088.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_3b886b3f0145a578ad32bf3905e6c088.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e81e50>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_c93ba95dba5d9c9c05a830dd95ae3442.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_c93ba95dba5d9c9c05a830dd95ae3442.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c8bad0>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_f92e66c99673f55151e6e8da04e06417.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_f92e66c99673f55151e6e8da04e06417.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d447d0>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_e5f1750aed1f83951103c6d50a8abae1.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e5f1750aed1f83951103c6d50a8abae1.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd3a10>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_99903551391ba36efc18b3569bb330f8.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_99903551391ba36efc18b3569bb330f8.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ffd150>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_f5641c8abd767c127211f1eb9c59891c.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_f5641c8abd767c127211f1eb9c59891c.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032e5750>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_1eea4c52632e53a14c3a6e5a133a9fb4.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_1eea4c52632e53a14c3a6e5a133a9fb4.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031cc850>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_f91aeffb4681e7c27d65189157318e3e.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_f91aeffb4681e7c27d65189157318e3e.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032842d0>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_04b1c80feb79de62069f175d1104109f.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_04b1c80feb79de62069f175d1104109f.jpg saved to cache
2026-03-27 20:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033fbe50>
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_29c3bfc86863bace56b1d74acbe3a6d2.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_29c3bfc86863bace56b1d74acbe3a6d2.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d19790>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_d544c2706cac9a7110faf588f7079fd2.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_d544c2706cac9a7110faf588f7079fd2.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_58008e4e12854a44771bdd3ab8e83cda.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_a48c80508ebe23ca1931299172a48cb6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_5747ab5715aaff0e78ed2ccb6c84977b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e898c7dfccf8b3746937827a4c176b09.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a9c5e1e68a33783f4f4f17cfb78e102f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_3d37cdb939448363a6309caab5779764.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_4ce7a44f2985c80641b07f47c6b13117.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_890851416cf94edca17c5254b0ece809.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_5155fc569bca5e462104b2034427fdcb.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ63338> (referer: https://www.auto1.com/v1/car-details-view/VJ63338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_f38dcbff4b44bf28f0b645ad2ab1b504.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_038778986a0e1d76219f9b22c201d70d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a15de9f83e8ebb6647b2a69c60b9895a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_50061edbd829901f96092941f192628a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_27dc4917a1ebabad3759c833474c1dd9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033fbe50>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_58008e4e12854a44771bdd3ab8e83cda.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_58008e4e12854a44771bdd3ab8e83cda.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_76f728f4e80b3a9c9c57b9b4fbb92cec.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_e3d28ef461ea2af799c068538f1de4e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_7bfd39b8724006433f0980375d4b5298.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_8cc9ed557938eb651d01b3ce352b2276.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_4ce8d83810b27797728616c44b314016.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903066950>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_a48c80508ebe23ca1931299172a48cb6.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_a48c80508ebe23ca1931299172a48cb6.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031d4e50>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_5747ab5715aaff0e78ed2ccb6c84977b.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_5747ab5715aaff0e78ed2ccb6c84977b.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce1b10>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_e898c7dfccf8b3746937827a4c176b09.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e898c7dfccf8b3746937827a4c176b09.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031f6810>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_a9c5e1e68a33783f4f4f17cfb78e102f.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a9c5e1e68a33783f4f4f17cfb78e102f.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ce07d0>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_3d37cdb939448363a6309caab5779764.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_3d37cdb939448363a6309caab5779764.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe
2026-03-27 20:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903225d90>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_4ce7a44f2985c80641b07f47c6b13117.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_4ce7a44f2985c80641b07f47c6b13117.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_6a113ab86de877df5c1385375731c40c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033e7710>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_890851416cf94edca17c5254b0ece809.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_890851416cf94edca17c5254b0ece809.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd0d50>
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_5155fc569bca5e462104b2034427fdcb.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_5155fc569bca5e462104b2034427fdcb.jpg saved to cache
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a38e05-ce7a-53be-9642-ceb9e10a0db5 with identifier: VJ63338
2026-03-27 20:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a38e05-ce7a-53be-9642-ceb9e10a0db5 with scrape type 1
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4a38e05-ce7a-53be-9642-ceb9e10a0db5
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_4a2edc9c3b14a89e008fe94a3542ede3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_4a2edc9c3b14a89e008fe94a3542ede3.jpg already downloaded
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_31c5b63fe7f5e811baad2cdba583aba8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_31c5b63fe7f5e811baad2cdba583aba8.jpg already downloaded
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_2173c65d777026de628dacbc5ffac553.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_2173c65d777026de628dacbc5ffac553.jpg already downloaded
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_ef183eb6dc173237e14a03be5db1aeb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_ef183eb6dc173237e14a03be5db1aeb5.jpg already downloaded
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_048293a9b20b0591bfb3705cd958dfcc.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_048293a9b20b0591bfb3705cd958dfcc.jpg already downloaded
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_42b821838ae93bac0adde0dc9aabb21b.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_42b821838ae93bac0adde0dc9aabb21b.jpg already downloaded
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_3e648963499570357a20618c35e70d91.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_3e648963499570357a20618c35e70d91.jpg already downloaded
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_1c3b0e82994f891d2ec1a2d83ae631ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_1c3b0e82994f891d2ec1a2d83ae631ac.jpg already downloaded
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_627a000d1a877b958dc50ae79dd77435.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_627a000d1a877b958dc50ae79dd77435.jpg already downloaded
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fe2%252F89e2c197bfdd7a1218f087174a39b5f3%252Fpa%252FVJ63338_9d0eaa842543af434d84294ed4973205.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_9d0eaa842543af434d84294ed4973205.jpg already downloaded
2026-03-27 20:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4a38e05-ce7a-53be-9642-ceb9e10a0db5, identifier: VJ63338
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903026d50>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_f38dcbff4b44bf28f0b645ad2ab1b504.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_f38dcbff4b44bf28f0b645ad2ab1b504.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903274810>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_038778986a0e1d76219f9b22c201d70d.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_038778986a0e1d76219f9b22c201d70d.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9e150>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_a15de9f83e8ebb6647b2a69c60b9895a.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a15de9f83e8ebb6647b2a69c60b9895a.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031caa50>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_50061edbd829901f96092941f192628a.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_50061edbd829901f96092941f192628a.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903ffd310>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_27dc4917a1ebabad3759c833474c1dd9.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_27dc4917a1ebabad3759c833474c1dd9.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dd13d0>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_76f728f4e80b3a9c9c57b9b4fbb92cec.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_76f728f4e80b3a9c9c57b9b4fbb92cec.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90306c990>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_e3d28ef461ea2af799c068538f1de4e2.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_e3d28ef461ea2af799c068538f1de4e2.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e32010>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_7bfd39b8724006433f0980375d4b5298.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_7bfd39b8724006433f0980375d4b5298.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c6f2d0>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_8cc9ed557938eb651d01b3ce352b2276.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_8cc9ed557938eb651d01b3ce352b2276.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912c54910>
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ffb%252F52fb7f2f4fd36f048b8da7db2a20ac2e%252Fpa%252FRS46918_4ce8d83810b27797728616c44b314016.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_4ce8d83810b27797728616c44b314016.jpg saved to cache
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1
2026-03-27 20:40:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1, skipping ID generation
2026-03-27 20:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with scrape type 1
2026-03-27 20:40:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 sending to next pipeline
2026-03-27 20:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1, identifier: RS46918
2026-03-27 20:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4a38e05-ce7a-53be-9642-ceb9e10a0db5 with identifier: VJ63338
2026-03-27 20:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4a38e05-ce7a-53be-9642-ceb9e10a0db5 with identifier: VJ63338
2026-03-27 20:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4a38e05-ce7a-53be-9642-ceb9e10a0db5 with identifier: VJ63338 to the API
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ63338>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:01:41Z',
 'fuel_type': 'diesel',
 'id': 'f4a38e05-ce7a-53be-9642-ceb9e10a0db5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ63338',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 183196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_4a2edc9c3b14a89e008fe94a3542ede3.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_31c5b63fe7f5e811baad2cdba583aba8.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_2173c65d777026de628dacbc5ffac553.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_ef183eb6dc173237e14a03be5db1aeb5.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_048293a9b20b0591bfb3705cd958dfcc.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_42b821838ae93bac0adde0dc9aabb21b.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_3e648963499570357a20618c35e70d91.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_1c3b0e82994f891d2ec1a2d83ae631ac.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_627a000d1a877b958dc50ae79dd77435.jpg',
                'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_9d0eaa842543af434d84294ed4973205.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_4a2edc9c3b14a89e008fe94a3542ede3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_31c5b63fe7f5e811baad2cdba583aba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_2173c65d777026de628dacbc5ffac553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_ef183eb6dc173237e14a03be5db1aeb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_048293a9b20b0591bfb3705cd958dfcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_42b821838ae93bac0adde0dc9aabb21b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_3e648963499570357a20618c35e70d91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_1c3b0e82994f891d2ec1a2d83ae631ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_627a000d1a877b958dc50ae79dd77435.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a38e05-ce7a-53be-9642-ceb9e10a0db5/f4a38e05-ce7a-53be-9642-ceb9e10a0db5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/e2/89e2c197bfdd7a1218f087174a39b5f3/pa/VJ63338_9d0eaa842543af434d84294ed4973205.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Affaires Pack Clim Plus Start/Stop',
 'transmission': 'manual',
 'trim': 'Affaires Pack Clim Plus Start/Stop',
 'year': 2018}
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ63338%27 HTTP/1.1" 200 None
2026-03-27 20:40:03 [auto1.be] INFO: Saving data for VJ63338: {'created_time': 1774644003.233846, 'last_price_update_time': 1774644003.233862, 'auction_closing_time': 1774713701.0}
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VJ63338') HTTP/1.1" 204 0
2026-03-27 20:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-27 20:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918
2026-03-27 20:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1 with identifier: RS46918 to the API
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_4ce8d83810b27797728616c44b314016.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:50:33Z',
 'fuel_type': 'petrol',
 'id': '071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS46918',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 31878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_1b4abe4d78e2b23ebc150b43645978c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_4ce8d83810b27797728616c44b314016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_27dc4917a1ebabad3759c833474c1dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a15de9f83e8ebb6647b2a69c60b9895a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_a9c5e1e68a33783f4f4f17cfb78e102f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_29c3bfc86863bace56b1d74acbe3a6d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_f5641c8abd767c127211f1eb9c59891c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_99903551391ba36efc18b3569bb330f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_3b886b3f0145a578ad32bf3905e6c088.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1/071b6eb8-7be1-51cd-ba8c-ed18da2ee3d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/fb/52fb7f2f4fd36f048b8da7db2a20ac2e/pa/RS46918_be77484ce314ff1885e25223e0425a5e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-27 20:40:03 [auto1.be] INFO: Saving data for RS46918: {'created_time': 1774644003.566721, 'last_price_update_time': 1774644003.566733, 'auction_closing_time': 1774716633.0}
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS46918') HTTP/1.1" 204 0
2026-03-27 20:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV25434> (referer: https://www.auto1.com/v1/car-details-view/MV25434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e70290>
2026-03-27 20:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_6a113ab86de877df5c1385375731c40c.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_6a113ab86de877df5c1385375731c40c.jpg saved to cache
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_aff4b9025779717412492fbc91ca1794.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_eae44534c11bf06602ff795454a0e378.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_81641d84e336d5266f18edd535d73650.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_bc818e7baa3cc4a46ffe672af0907241.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b567512-a2f7-51ca-8985-297196327550 with identifier: MV25434
2026-03-27 20:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b567512-a2f7-51ca-8985-297196327550 with scrape type 1
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0b567512-a2f7-51ca-8985-297196327550
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4a%252F7b4a5ddd8a0c169b9b29e297008743c4%252Fpa%252FMV25434_41818d66c29e5891e61298c46b8c6c4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_41818d66c29e5891e61298c46b8c6c4a.jpg already downloaded
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4a%252F7b4a5ddd8a0c169b9b29e297008743c4%252Fpa%252FMV25434_9b74edb263900f62f0ad50841125c5e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_9b74edb263900f62f0ad50841125c5e3.jpg already downloaded
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4a%252F7b4a5ddd8a0c169b9b29e297008743c4%252Fpa%252FMV25434_b50478d8ba5c10eb921df68dec29ed39.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_b50478d8ba5c10eb921df68dec29ed39.jpg already downloaded
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4a%252F7b4a5ddd8a0c169b9b29e297008743c4%252Fpa%252FMV25434_03feb5a626fa7c4e81c159b85fe7cb6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_03feb5a626fa7c4e81c159b85fe7cb6d.jpg already downloaded
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4a%252F7b4a5ddd8a0c169b9b29e297008743c4%252Fpa%252FMV25434_a245e92703bde7f9472a9122db2bc7fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_a245e92703bde7f9472a9122db2bc7fa.jpg already downloaded
2026-03-27 20:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0b567512-a2f7-51ca-8985-297196327550, identifier: MV25434
2026-03-27 20:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_943af61fa082e6c29e3ae2e21a00b59c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0b567512-a2f7-51ca-8985-297196327550 with identifier: MV25434
2026-03-27 20:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0b567512-a2f7-51ca-8985-297196327550 with identifier: MV25434
2026-03-27 20:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0b567512-a2f7-51ca-8985-297196327550 with identifier: MV25434 to the API
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MV25434>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:55Z',
 'fuel_type': 'petrol',
 'id': '0b567512-a2f7-51ca-8985-297196327550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV25434',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 205358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_41818d66c29e5891e61298c46b8c6c4a.jpg',
                'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_9b74edb263900f62f0ad50841125c5e3.jpg',
                'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_b50478d8ba5c10eb921df68dec29ed39.jpg',
                'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_03feb5a626fa7c4e81c159b85fe7cb6d.jpg',
                'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_a245e92703bde7f9472a9122db2bc7fa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b567512-a2f7-51ca-8985-297196327550/0b567512-a2f7-51ca-8985-297196327550_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_41818d66c29e5891e61298c46b8c6c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b567512-a2f7-51ca-8985-297196327550/0b567512-a2f7-51ca-8985-297196327550_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_9b74edb263900f62f0ad50841125c5e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b567512-a2f7-51ca-8985-297196327550/0b567512-a2f7-51ca-8985-297196327550_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_b50478d8ba5c10eb921df68dec29ed39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b567512-a2f7-51ca-8985-297196327550/0b567512-a2f7-51ca-8985-297196327550_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_03feb5a626fa7c4e81c159b85fe7cb6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b567512-a2f7-51ca-8985-297196327550/0b567512-a2f7-51ca-8985-297196327550_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4a/7b4a5ddd8a0c169b9b29e297008743c4/pa/MV25434_a245e92703bde7f9472a9122db2bc7fa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV25434%27 HTTP/1.1" 200 None
2026-03-27 20:40:04 [auto1.be] INFO: Saving data for MV25434: {'created_time': 1774644004.246425, 'last_price_update_time': 1774644004.246435, 'auction_closing_time': 1774713775.0}
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV25434') HTTP/1.1" 204 0
2026-03-27 20:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_ab1b82fe9bc39225ef5f58cc54b157fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_d38d7367d23a0d74340064ac6691ddb5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_7e3d2b71c0950d9c467b959996b0ce38.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90311ef10>
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_aff4b9025779717412492fbc91ca1794.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_aff4b9025779717412492fbc91ca1794.jpg saved to cache
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f63390>
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_eae44534c11bf06602ff795454a0e378.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_eae44534c11bf06602ff795454a0e378.jpg saved to cache
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903324410>
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_81641d84e336d5266f18edd535d73650.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_81641d84e336d5266f18edd535d73650.jpg saved to cache
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903324d10>
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F63%252Ff763ca167b6cdb3d923431fa9ee3e1ab%252Fpa%252FSP17871_bc818e7baa3cc4a46ffe672af0907241.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_bc818e7baa3cc4a46ffe672af0907241.jpg saved to cache
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bad21a3-999a-53ff-b098-0a17cae18891
2026-03-27 20:40:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bad21a3-999a-53ff-b098-0a17cae18891, skipping ID generation
2026-03-27 20:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bad21a3-999a-53ff-b098-0a17cae18891 with scrape type 1
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bad21a3-999a-53ff-b098-0a17cae18891 sending to next pipeline
2026-03-27 20:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8bad21a3-999a-53ff-b098-0a17cae18891, identifier: SP17871
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90321c8d0>
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_943af61fa082e6c29e3ae2e21a00b59c.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_943af61fa082e6c29e3ae2e21a00b59c.jpg saved to cache
2026-03-27 20:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe
2026-03-27 20:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8bad21a3-999a-53ff-b098-0a17cae18891 with identifier: SP17871
2026-03-27 20:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8bad21a3-999a-53ff-b098-0a17cae18891 with identifier: SP17871
2026-03-27 20:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8bad21a3-999a-53ff-b098-0a17cae18891 with identifier: SP17871 to the API
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_bc818e7baa3cc4a46ffe672af0907241.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:54:15Z',
 'fuel_type': 'diesel',
 'id': '8bad21a3-999a-53ff-b098-0a17cae18891',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP17871',
 'listing': 'auction',
 'location': 'BE, Lommel',
 'make': 'BMW',
 'model': '1er',
 'odometer': 179076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_bc818e7baa3cc4a46ffe672af0907241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_eae44534c11bf06602ff795454a0e378.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_7bfd39b8724006433f0980375d4b5298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_038778986a0e1d76219f9b22c201d70d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_5747ab5715aaff0e78ed2ccb6c84977b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e898c7dfccf8b3746937827a4c176b09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_04b1c80feb79de62069f175d1104109f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_f92e66c99673f55151e6e8da04e06417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_e5f1750aed1f83951103c6d50a8abae1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bad21a3-999a-53ff-b098-0a17cae18891/8bad21a3-999a-53ff-b098-0a17cae18891_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/63/f763ca167b6cdb3d923431fa9ee3e1ab/pa/SP17871_c93ba95dba5d9c9c05a830dd95ae3442.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 20:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP17871%27 HTTP/1.1" 200 None
2026-03-27 20:40:05 [auto1.be] INFO: Saving data for SP17871: {'created_time': 1774644005.007012, 'last_price_update_time': 1774644005.007023, 'auction_closing_time': 1774716855.0}
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SP17871') HTTP/1.1" 204 0
2026-03-27 20:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_871a33cdf216250fce6bfeba11b0be34.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_ad4ca8cba61e8c35cfbe206b3f1e1b9a.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_8fb81f5add4e85cf282c293a50e5c736.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6da2bada02258800b2b9cc0b8809c51e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe912634e50>
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F40%252F544021b92f59494c516fbabd478df322%252Fpa%252FMA13965_ab1b82fe9bc39225ef5f58cc54b157fe.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_ab1b82fe9bc39225ef5f58cc54b157fe.jpg saved to cache
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe
2026-03-27 20:40:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe, skipping ID generation
2026-03-27 20:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe with scrape type 1
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe sending to next pipeline
2026-03-27 20:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe, identifier: MA13965
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e96d50>
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_d38d7367d23a0d74340064ac6691ddb5.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_d38d7367d23a0d74340064ac6691ddb5.jpg saved to cache
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903e95410>
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_7e3d2b71c0950d9c467b959996b0ce38.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_7e3d2b71c0950d9c467b959996b0ce38.jpg saved to cache
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_9f7b9a316b91edeee0afc98c734a9f13.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe with identifier: MA13965
2026-03-27 20:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe with identifier: MA13965
2026-03-27 20:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe with identifier: MA13965 to the API
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_ab1b82fe9bc39225ef5f58cc54b157fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:03Z',
 'fuel_type': 'diesel',
 'id': 'fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA13965',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 326890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_943af61fa082e6c29e3ae2e21a00b59c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_ab1b82fe9bc39225ef5f58cc54b157fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_e3d28ef461ea2af799c068538f1de4e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_f38dcbff4b44bf28f0b645ad2ab1b504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_3d37cdb939448363a6309caab5779764.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe/fcafe08a-e45f-56f2-ab22-ccc1fb4a8cbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/40/544021b92f59494c516fbabd478df322/pa/MA13965_a48c80508ebe23ca1931299172a48cb6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI T BlueTEC',
 'transmission': 'manual',
 'trim': 'T BlueTEC',
 'year': 2014}
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA13965%27 HTTP/1.1" 200 None
2026-03-27 20:40:05 [auto1.be] INFO: Saving data for MA13965: {'created_time': 1774644005.637162, 'last_price_update_time': 1774644005.637172, 'auction_closing_time': 1774716183.0}
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA13965') HTTP/1.1" 204 0
2026-03-27 20:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_78181756cb8b3809113b296a9411ea1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032230d0>
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_871a33cdf216250fce6bfeba11b0be34.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_871a33cdf216250fce6bfeba11b0be34.jpg saved to cache
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2c110>
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F64%252Fd864fef91ccf0fbfa98530e52a68c09c%252Fpa%252FZU40891_ad4ca8cba61e8c35cfbe206b3f1e1b9a.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_ad4ca8cba61e8c35cfbe206b3f1e1b9a.jpg saved to cache
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8f33e01-cff8-577f-bd44-766fb6a324f1
2026-03-27 20:40:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8f33e01-cff8-577f-bd44-766fb6a324f1, skipping ID generation
2026-03-27 20:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f33e01-cff8-577f-bd44-766fb6a324f1 with scrape type 1
2026-03-27 20:40:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8f33e01-cff8-577f-bd44-766fb6a324f1 sending to next pipeline
2026-03-27 20:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8f33e01-cff8-577f-bd44-766fb6a324f1, identifier: ZU40891
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d01410>
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_8fb81f5add4e85cf282c293a50e5c736.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_8fb81f5add4e85cf282c293a50e5c736.jpg saved to cache
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90315d310>
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_4.jpg HTTP/1.1" 201 0
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_6da2bada02258800b2b9cc0b8809c51e.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6da2bada02258800b2b9cc0b8809c51e.jpg saved to cache
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:40:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903126450>
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_9f7b9a316b91edeee0afc98c734a9f13.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_9f7b9a316b91edeee0afc98c734a9f13.jpg saved to cache
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8f33e01-cff8-577f-bd44-766fb6a324f1 with identifier: ZU40891
2026-03-27 20:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8f33e01-cff8-577f-bd44-766fb6a324f1 with identifier: ZU40891
2026-03-27 20:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8f33e01-cff8-577f-bd44-766fb6a324f1 with identifier: ZU40891 to the API
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_ad4ca8cba61e8c35cfbe206b3f1e1b9a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:45:58Z',
 'fuel_type': 'petrol',
 'id': 'c8f33e01-cff8-577f-bd44-766fb6a324f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU40891',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'Nemo',
 'odometer': 163931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_ad4ca8cba61e8c35cfbe206b3f1e1b9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_d38d7367d23a0d74340064ac6691ddb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_7e3d2b71c0950d9c467b959996b0ce38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_aff4b9025779717412492fbc91ca1794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_8cc9ed557938eb651d01b3ce352b2276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_50061edbd829901f96092941f192628a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_5155fc569bca5e462104b2034427fdcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_58008e4e12854a44771bdd3ab8e83cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_f91aeffb4681e7c27d65189157318e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f33e01-cff8-577f-bd44-766fb6a324f1/c8f33e01-cff8-577f-bd44-766fb6a324f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/64/d864fef91ccf0fbfa98530e52a68c09c/pa/ZU40891_1eea4c52632e53a14c3a6e5a133a9fb4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Nemo 1.4 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU40891%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Saving data for ZU40891: {'created_time': 1774644006.634229, 'last_price_update_time': 1774644006.634242, 'auction_closing_time': 1774716358.0}
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU40891') HTTP/1.1" 204 0
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_05aa23d44ea1144bb4ae9844fda32249.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903256bd0>
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_78181756cb8b3809113b296a9411ea1d.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_78181756cb8b3809113b296a9411ea1d.jpg saved to cache
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:40:06 [scrapy.extensions.logstats] INFO: Crawled 306 pages (at 45 pages/min), scraped 296 items (at 47 items/min)
2026-03-27 20:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 199MiB
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0f8333b0afed18656ad979d7772abfa0.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_c4801ce33e75b71e2af7524987a9da44.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_ca2f5834ee5336ee35b7ab8095df72ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_4e8ec62c496709e3e3e0ea1ccec5ac5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_d1114395681961e105812009816599b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_fabc5ca22aec73ce72d2676223a7da30.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_c321aa1598414624e1a3dcedd5c7194e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d2ebd0>
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_05aa23d44ea1144bb4ae9844fda32249.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_05aa23d44ea1144bb4ae9844fda32249.jpg saved to cache
2026-03-27 20:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_71a70fd5c9427b800ab329e37f828011.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_19b9d9e2fa9e6f18c4420fa12382ded1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:06 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1659 | hits on page: 40
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-27 20:40:06 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-27 20:40:06 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-27 20:40:07 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-27 20:40:07 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-27 20:40:07 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-27 20:40:07 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-27 20:40:07 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-27 20:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0818e200593984c7bfef0f7f2f440583.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dead90>
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_0f8333b0afed18656ad979d7772abfa0.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0f8333b0afed18656ad979d7772abfa0.jpg saved to cache
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9df90>
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd1%252F32d1fc774d35c89871bd629c2bdeb8c3%252Fpa%252FZJ47299_c4801ce33e75b71e2af7524987a9da44.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_c4801ce33e75b71e2af7524987a9da44.jpg saved to cache
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8b03b22-9027-5a94-8b1f-e3d7022a458c
2026-03-27 20:40:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8b03b22-9027-5a94-8b1f-e3d7022a458c, skipping ID generation
2026-03-27 20:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8b03b22-9027-5a94-8b1f-e3d7022a458c with scrape type 1
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8b03b22-9027-5a94-8b1f-e3d7022a458c sending to next pipeline
2026-03-27 20:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b8b03b22-9027-5a94-8b1f-e3d7022a458c, identifier: ZJ47299
2026-03-27 20:40:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903fa7c90>
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_ca2f5834ee5336ee35b7ab8095df72ac.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_ca2f5834ee5336ee35b7ab8095df72ac.jpg saved to cache
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:40:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdf490>
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_4e8ec62c496709e3e3e0ea1ccec5ac5c.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_4e8ec62c496709e3e3e0ea1ccec5ac5c.jpg saved to cache
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:40:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032c2010>
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_d1114395681961e105812009816599b6.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_d1114395681961e105812009816599b6.jpg saved to cache
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:40:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cde5d0>
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_9.jpg HTTP/1.1" 201 0
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_fabc5ca22aec73ce72d2676223a7da30.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_fabc5ca22aec73ce72d2676223a7da30.jpg saved to cache
2026-03-27 20:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:40:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cdc9d0>
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_c321aa1598414624e1a3dcedd5c7194e.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_c321aa1598414624e1a3dcedd5c7194e.jpg saved to cache
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90317e010>
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_71a70fd5c9427b800ab329e37f828011.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_71a70fd5c9427b800ab329e37f828011.jpg saved to cache
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90306efd0>
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_19b9d9e2fa9e6f18c4420fa12382ded1.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_19b9d9e2fa9e6f18c4420fa12382ded1.jpg saved to cache
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-27 20:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299
2026-03-27 20:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b8b03b22-9027-5a94-8b1f-e3d7022a458c with identifier: ZJ47299 to the API
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_c4801ce33e75b71e2af7524987a9da44.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:59Z',
 'fuel_type': 'petrol',
 'id': 'b8b03b22-9027-5a94-8b1f-e3d7022a458c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ47299',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 113081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350679,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_8fb81f5add4e85cf282c293a50e5c736.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_9f7b9a316b91edeee0afc98c734a9f13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_871a33cdf216250fce6bfeba11b0be34.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_c4801ce33e75b71e2af7524987a9da44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328373,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_6a113ab86de877df5c1385375731c40c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_76f728f4e80b3a9c9c57b9b4fbb92cec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2666712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_81641d84e336d5266f18edd535d73650.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614466,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_890851416cf94edca17c5254b0ece809.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360973,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_d544c2706cac9a7110faf588f7079fd2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8b03b22-9027-5a94-8b1f-e3d7022a458c/b8b03b22-9027-5a94-8b1f-e3d7022a458c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d1/32d1fc774d35c89871bd629c2bdeb8c3/pa/ZJ47299_4ce7a44f2985c80641b07f47c6b13117.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 MIVEC Invite 2WD',
 'transmission': 'manual',
 'trim': 'Invite 2WD',
 'year': 2015}
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-27 20:40:08 [auto1.be] INFO: Saving data for ZJ47299: {'created_time': 1774644008.509825, 'last_price_update_time': 1774644008.509838, 'auction_closing_time': 1774716119.0}
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ47299') HTTP/1.1" 204 0
2026-03-27 20:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4d8822d39807c122b219220a8c5a1a1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dad150>
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F2d%252Fff2d8a831ea3d1f0b8b4c534b31cce11%252Fpa%252FHU58936_0818e200593984c7bfef0f7f2f440583.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0818e200593984c7bfef0f7f2f440583.jpg saved to cache
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728
2026-03-27 20:40:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c7a7961-d7b1-5951-a8eb-7c1d22350728, skipping ID generation
2026-03-27 20:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with scrape type 1
2026-03-27 20:40:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c7a7961-d7b1-5951-a8eb-7c1d22350728 sending to next pipeline
2026-03-27 20:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c7a7961-d7b1-5951-a8eb-7c1d22350728, identifier: HU58936
2026-03-27 20:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-27 20:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936
2026-03-27 20:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c7a7961-d7b1-5951-a8eb-7c1d22350728 with identifier: HU58936 to the API
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0818e200593984c7bfef0f7f2f440583.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:06:19Z',
 'fuel_type': 'diesel',
 'id': '9c7a7961-d7b1-5951-a8eb-7c1d22350728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU58936',
 'listing': 'auction',
 'location': 'BE, Anderlues',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 59840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6176887466be560dff1624dacc30ada4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0818e200593984c7bfef0f7f2f440583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_19b9d9e2fa9e6f18c4420fa12382ded1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_78181756cb8b3809113b296a9411ea1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_6da2bada02258800b2b9cc0b8809c51e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_856729b7f8738796fe29d6b57e79a07d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_bf4b4dc43dba3331c86035be297a15b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_0ddb4fcd3be208d41d4e0e2aa9fd1285.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_5dbf0149370854213fe803cdf8d63999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7a7961-d7b1-5951-a8eb-7c1d22350728/9c7a7961-d7b1-5951-a8eb-7c1d22350728_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/2d/ff2d8a831ea3d1f0b8b4c534b31cce11/pa/HU58936_2c4b000f5bd6e35a1654d0f123032d1e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2014}
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-27 20:40:09 [auto1.be] INFO: Saving data for HU58936: {'created_time': 1774644009.093823, 'last_price_update_time': 1774644009.093835, 'auction_closing_time': 1774713979.0}
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU58936') HTTP/1.1" 204 0
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c89010>
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_4d8822d39807c122b219220a8c5a1a1e.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4d8822d39807c122b219220a8c5a1a1e.jpg saved to cache
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_fe569398039dc33c123edf221aa93fde.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_c128ef0958e6cba68e7e4e27861ae98e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_3469afe72a4a70aeb7b63d44b1fe6225.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_2fe60ef6809fc1fd63365a161b67c9d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_7c518c4a5ac398416c93c8ddee101e4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_2dde1adc073dccdf693d178ef9a15f28.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_2959de837ee78a1929c13247cf7aaf2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_212ce87620374900acf927640d54acda.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903caf050>
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_fe569398039dc33c123edf221aa93fde.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_fe569398039dc33c123edf221aa93fde.jpg saved to cache
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_912a3b4e6c0df8b65c00fdba9b8d744e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_f4bbea5af8c7fe4ac885c9267e683565.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_0ed01a644a3150ff2ce0b685b04944f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9031e6dd0>
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_c128ef0958e6cba68e7e4e27861ae98e.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_c128ef0958e6cba68e7e4e27861ae98e.jpg saved to cache
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc8050>
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_7.jpg HTTP/1.1" 201 0
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_3469afe72a4a70aeb7b63d44b1fe6225.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_3469afe72a4a70aeb7b63d44b1fe6225.jpg saved to cache
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d5e810>
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fce%252Fdcce5252e416c4ab074a2c5d986ec2f5%252Fpa%252FNU98421_2fe60ef6809fc1fd63365a161b67c9d2.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_2fe60ef6809fc1fd63365a161b67c9d2.jpg saved to cache
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 925d536b-fe72-535e-ba07-122209d6df04
2026-03-27 20:40:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 925d536b-fe72-535e-ba07-122209d6df04, skipping ID generation
2026-03-27 20:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925d536b-fe72-535e-ba07-122209d6df04 with scrape type 1
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 925d536b-fe72-535e-ba07-122209d6df04 sending to next pipeline
2026-03-27 20:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 925d536b-fe72-535e-ba07-122209d6df04, identifier: NU98421
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903261fd0>
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_7c518c4a5ac398416c93c8ddee101e4f.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_7c518c4a5ac398416c93c8ddee101e4f.jpg saved to cache
2026-03-27 20:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:40:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d5cd10>
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_8.jpg HTTP/1.1" 201 0
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_2dde1adc073dccdf693d178ef9a15f28.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_2dde1adc073dccdf693d178ef9a15f28.jpg saved to cache
2026-03-27 20:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:40:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe90330c5d0>
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_2959de837ee78a1929c13247cf7aaf2f.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_2959de837ee78a1929c13247cf7aaf2f.jpg saved to cache
2026-03-27 20:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:40:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033a4090>
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fb5%252F60b5c5c269929dd965ee8c3b1ef54988%252Fpa%252FBV56621_212ce87620374900acf927640d54acda.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_212ce87620374900acf927640d54acda.jpg saved to cache
2026-03-27 20:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54af18b5-21b7-5c6d-b43c-996322979c28
2026-03-27 20:40:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54af18b5-21b7-5c6d-b43c-996322979c28, skipping ID generation
2026-03-27 20:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54af18b5-21b7-5c6d-b43c-996322979c28 with scrape type 1
2026-03-27 20:40:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54af18b5-21b7-5c6d-b43c-996322979c28 sending to next pipeline
2026-03-27 20:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54af18b5-21b7-5c6d-b43c-996322979c28, identifier: BV56621
2026-03-27 20:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-27 20:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421
2026-03-27 20:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 925d536b-fe72-535e-ba07-122209d6df04 with identifier: NU98421 to the API
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_2fe60ef6809fc1fd63365a161b67c9d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:20:26Z',
 'fuel_type': 'diesel',
 'id': '925d536b-fe72-535e-ba07-122209d6df04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU98421',
 'listing': 'auction',
 'location': 'BE, Wanze',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 188143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2639830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_2fe60ef6809fc1fd63365a161b67c9d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_c321aa1598414624e1a3dcedd5c7194e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_ca2f5834ee5336ee35b7ab8095df72ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549065,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_f22b8086a9ce06ba15597589f9e392bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_54be774d4d40c3ff5704126d9a2ea7af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2485442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_1d27a241e8f7be3d0e8b7164f9526457.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_0a069f4000aa8ab188b0ca225be64f24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2598193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_3c68e10f53a2aeaa2020b58750ae721d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_882740f2cb6f33a959af2494f82213ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925d536b-fe72-535e-ba07-122209d6df04/925d536b-fe72-535e-ba07-122209d6df04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/ce/dcce5252e416c4ab074a2c5d986ec2f5/pa/NU98421_a80be68c0d571083ea3d3c8fe2b25bbe.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2015}
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-27 20:40:10 [auto1.be] INFO: Saving data for NU98421: {'created_time': 1774644010.916528, 'last_price_update_time': 1774644010.916541, 'auction_closing_time': 1774714826.0}
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU98421') HTTP/1.1" 204 0
2026-03-27 20:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-27 20:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621
2026-03-27 20:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54af18b5-21b7-5c6d-b43c-996322979c28 with identifier: BV56621 to the API
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_212ce87620374900acf927640d54acda.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:17:33Z',
 'fuel_type': 'gas',
 'id': '54af18b5-21b7-5c6d-b43c-996322979c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV56621',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 147940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_2959de837ee78a1929c13247cf7aaf2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_212ce87620374900acf927640d54acda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_4e8ec62c496709e3e3e0ea1ccec5ac5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556507,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_af79c5c5160699848e5b7838c75eda2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2466126,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_851f7f4d16b89a416bfccd221b955d09.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d095322f1a77d40a2189120ef9c2fd91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2366309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_bd0a4645968f55416e76a3f044cd6194.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759388,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_d02346c6cb125ca94425468ecde7e1fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_57f1ca1a5b768bfc1bbabf76a3fd2911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54af18b5-21b7-5c6d-b43c-996322979c28/54af18b5-21b7-5c6d-b43c-996322979c28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323153,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/b5/60b5c5c269929dd965ee8c3b1ef54988/pa/BV56621_38ee106f8406a3f9ca834dcef6fc92b0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2021}
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Saving data for BV56621: {'created_time': 1774644011.260984, 'last_price_update_time': 1774644011.260994, 'auction_closing_time': 1774714653.0}
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV56621') HTTP/1.1" 204 0
2026-03-27 20:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903f9bc90>
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_912a3b4e6c0df8b65c00fdba9b8d744e.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_912a3b4e6c0df8b65c00fdba9b8d744e.jpg saved to cache
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9033ead50>
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_f4bbea5af8c7fe4ac885c9267e683565.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_f4bbea5af8c7fe4ac885c9267e683565.jpg saved to cache
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d07a10>
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_0ed01a644a3150ff2ce0b685b04944f3.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_0ed01a644a3150ff2ce0b685b04944f3.jpg saved to cache
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4a961bcb25e5afe6963fa9c2a4b3d1ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:11 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1659 | hits on page: 40
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL14568%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for HL14568: 0
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW89679%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for BW89679: 0
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for NV81106: 2
2026-03-27 20:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-27 20:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3732b551-8397-54e7-ac71-594bf19ce099 with scrape type 2
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3732b551-8397-54e7-ac71-594bf19ce099 with scrape type 2
2026-03-27 20:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3732b551-8397-54e7-ac71-594bf19ce099, identifier: NV81106
2026-03-27 20:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-27 20:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106
2026-03-27 20:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3732b551-8397-54e7-ac71-594bf19ce099 with identifier: NV81106 to the API
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:44Z',
 'fuel_type': 'petrol',
 'id': '3732b551-8397-54e7-ac71-594bf19ce099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV81106',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 131485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Saving data for NV81106: {'auction_closing_time': 1774716824.0, 'created_time': 1773224675.537605, 'last_price_update_time': 1774644011.905983}
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV81106') HTTP/1.1" 204 0
2026-03-27 20:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_b8c8caa0780f7f8f903d09ccfde78d54.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV58178%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for KV58178: 0
2026-03-27 20:40:11 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-27 20:40:11 [auto1.be] INFO: Scrape type for TP16646: 2
2026-03-27 20:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-27 20:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19e2218-b800-5812-afe4-a97b7adc0024 with scrape type 2
2026-03-27 20:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19e2218-b800-5812-afe4-a97b7adc0024 with scrape type 2
2026-03-27 20:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b19e2218-b800-5812-afe4-a97b7adc0024, identifier: TP16646
2026-03-27 20:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-27 20:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646
2026-03-27 20:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b19e2218-b800-5812-afe4-a97b7adc0024 with identifier: TP16646 to the API
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:00:30Z',
 'fuel_type': 'petrol',
 'id': 'b19e2218-b800-5812-afe4-a97b7adc0024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP16646',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 127886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-27 20:40:12 [auto1.be] INFO: Saving data for TP16646: {'auction_closing_time': 1774713630.0, 'created_time': 1773301759.237631, 'last_price_update_time': 1774644012.449044}
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TP16646') HTTP/1.1" 204 0
2026-03-27 20:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903dcee10>
2026-03-27 20:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_4a961bcb25e5afe6963fa9c2a4b3d1ff.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4a961bcb25e5afe6963fa9c2a4b3d1ff.jpg saved to cache
2026-03-27 20:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-27 20:40:12 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-27 20:40:12 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-27 20:40:12 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-27 20:40:12 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-27 20:40:12 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-27 20:40:12 [auto1.be] INFO: Scrape type for FG26500: 2
2026-03-27 20:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-27 20:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with scrape type 2
2026-03-27 20:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with scrape type 2
2026-03-27 20:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c, identifier: FG26500
2026-03-27 20:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-27 20:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500
2026-03-27 20:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d03f3a5b-3a25-51c7-8dfc-224a0197bd7c with identifier: FG26500 to the API
2026-03-27 20:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:47:05Z',
 'fuel_type': 'petrol',
 'id': 'd03f3a5b-3a25-51c7-8dfc-224a0197bd7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG26500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 103179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-13',
 'seller_name': None,
 'title': 'Opel Insignia 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Saving data for FG26500: {'auction_closing_time': 1774716425.0, 'created_time': 1773834457.531177, 'last_price_update_time': 1774644013.132786}
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG26500') HTTP/1.1" 204 0
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe911e46b90>
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_b8c8caa0780f7f8f903d09ccfde78d54.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_b8c8caa0780f7f8f903d09ccfde78d54.jpg saved to cache
2026-03-27 20:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN53703%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for UN53703: 2
2026-03-27 20:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c42f8fb-d081-56b4-ad30-5f9d43b7a5de with identifier: UN53703
2026-03-27 20:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c42f8fb-d081-56b4-ad30-5f9d43b7a5de with scrape type 2
2026-03-27 20:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c42f8fb-d081-56b4-ad30-5f9d43b7a5de with scrape type 2
2026-03-27 20:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c42f8fb-d081-56b4-ad30-5f9d43b7a5de, identifier: UN53703
2026-03-27 20:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c42f8fb-d081-56b4-ad30-5f9d43b7a5de with identifier: UN53703
2026-03-27 20:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c42f8fb-d081-56b4-ad30-5f9d43b7a5de with identifier: UN53703
2026-03-27 20:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c42f8fb-d081-56b4-ad30-5f9d43b7a5de with identifier: UN53703 to the API
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:52:14Z',
 'fuel_type': 'petrol',
 'id': '4c42f8fb-d081-56b4-ad30-5f9d43b7a5de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN53703',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 63318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-17',
 'seller_name': None,
 'title': 'Jaguar E-Pace P250 HSE AWD',
 'transmission': 'automatic',
 'trim': 'HSE AWD',
 'year': 2018}
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN53703%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Saving data for UN53703: {'auction_closing_time': 1774716734.0, 'created_time': 1773780043.057311, 'last_price_update_time': 1774644013.620733}
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UN53703') HTTP/1.1" 204 0
2026-03-27 20:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_99a580f0ec6028464115c5d0b10690e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-27 20:40:13 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-27 20:40:13 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-27 20:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_fb898ea496b7eb9eca762c1de20987e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903165f90>
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_99a580f0ec6028464115c5d0b10690e1.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_99a580f0ec6028464115c5d0b10690e1.jpg saved to cache
2026-03-27 20:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_7b7089ee2c4bf912ad364b4026378245.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_ed164ea5ef145828f09d3b61456482f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e37ce2884ae05e2e7968e3b0c2824d68.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_26afd886918c3f81f66b464bd5cb413d.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_b37edc670bfba33fb15c5c0bcc0e7be7.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9030c6f50>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_fb898ea496b7eb9eca762c1de20987e9.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_fb898ea496b7eb9eca762c1de20987e9.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_81a185d0ba2dcc5ebe2b828072df6310.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_ddfeccee006c7ce6bd166e4bdd29bd77.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a7af69e00f96aeb6105e43bf1158dc39.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_87b77d91ecabf48129ec6dc2657214f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903288290>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_7b7089ee2c4bf912ad364b4026378245.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_7b7089ee2c4bf912ad364b4026378245.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d48c50>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_ed164ea5ef145828f09d3b61456482f1.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_ed164ea5ef145828f09d3b61456482f1.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d83cd0>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_6.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_e37ce2884ae05e2e7968e3b0c2824d68.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e37ce2884ae05e2e7968e3b0c2824d68.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c67690>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_26afd886918c3f81f66b464bd5cb413d.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_26afd886918c3f81f66b464bd5cb413d.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe91fac7d50>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_b37edc670bfba33fb15c5c0bcc0e7be7.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_b37edc670bfba33fb15c5c0bcc0e7be7.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW39031> (referer: https://www.auto1.com/v1/car-details-view/BW39031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903335590>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_81a185d0ba2dcc5ebe2b828072df6310.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_81a185d0ba2dcc5ebe2b828072df6310.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903c9ea90>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_2.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F68%252F25687b9072446ccd537243b7c3b681ab%252Fpa%252FBV41613_ddfeccee006c7ce6bd166e4bdd29bd77.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_ddfeccee006c7ce6bd166e4bdd29bd77.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78
2026-03-27 20:40:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78, skipping ID generation
2026-03-27 20:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with scrape type 1
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 sending to next pipeline
2026-03-27 20:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78, identifier: BV41613
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d06a90>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc0%252Ff2c0f52a137cf70bcfc693d059c5b5ee%252Fpa%252FHM47736_a7af69e00f96aeb6105e43bf1158dc39.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a7af69e00f96aeb6105e43bf1158dc39.jpg saved to cache
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17002efe-7880-5c23-ba84-ffe2498431cb
2026-03-27 20:40:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17002efe-7880-5c23-ba84-ffe2498431cb, skipping ID generation
2026-03-27 20:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17002efe-7880-5c23-ba84-ffe2498431cb with scrape type 1
2026-03-27 20:40:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17002efe-7880-5c23-ba84-ffe2498431cb sending to next pipeline
2026-03-27 20:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17002efe-7880-5c23-ba84-ffe2498431cb, identifier: HM47736
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9120ca210>
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_87b77d91ecabf48129ec6dc2657214f5.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_87b77d91ecabf48129ec6dc2657214f5.jpg saved to cache
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0cd099d0f3fe6eded6779beca675260b.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-27 20:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613
2026-03-27 20:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 887d96fd-a4ef-5610-a527-9ed2c3b6ff78 with identifier: BV41613 to the API
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_ddfeccee006c7ce6bd166e4bdd29bd77.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:30:06Z',
 'fuel_type': 'diesel',
 'id': '887d96fd-a4ef-5610-a527-9ed2c3b6ff78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV41613',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 229780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_b1208e486138ad30a0af07cc61662908.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_2de8a6d004107227c2019fb84ef09b90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_ddfeccee006c7ce6bd166e4bdd29bd77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_7b5f6959c13a6be368012977856db7a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_05b5ce5fe82b538087e045f19e57232d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887d96fd-a4ef-5610-a527-9ed2c3b6ff78/887d96fd-a4ef-5610-a527-9ed2c3b6ff78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/68/25687b9072446ccd537243b7c3b681ab/pa/BV41613_658a760a51f37b65b58473fbd4b31992.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [auto1.be] INFO: Saving data for BV41613: {'created_time': 1774644015.360964, 'last_price_update_time': 1774644015.360974, 'auction_closing_time': 1774715406.0}
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV41613') HTTP/1.1" 204 0
2026-03-27 20:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-27 20:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736
2026-03-27 20:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17002efe-7880-5c23-ba84-ffe2498431cb with identifier: HM47736 to the API
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a7af69e00f96aeb6105e43bf1158dc39.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.9L',
 'engine_horse_power': 381,
 'expiration_date': '2026-03-28T16:19:45Z',
 'fuel_type': 'petrol',
 'id': '17002efe-7880-5c23-ba84-ffe2498431cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM47736',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 70589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_81a185d0ba2dcc5ebe2b828072df6310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a7af69e00f96aeb6105e43bf1158dc39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_b8c8caa0780f7f8f903d09ccfde78d54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_f4bbea5af8c7fe4ac885c9267e683565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_a97b6fba562792b2afd74d19ee3d3fee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_0ed01a644a3150ff2ce0b685b04944f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_912a3b4e6c0df8b65c00fdba9b8d744e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_fe569398039dc33c123edf221aa93fde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_71a70fd5c9427b800ab329e37f828011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17002efe-7880-5c23-ba84-ffe2498431cb/17002efe-7880-5c23-ba84-ffe2498431cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c0/f2c0f52a137cf70bcfc693d059c5b5ee/pa/HM47736_05aa23d44ea1144bb4ae9844fda32249.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [auto1.be] INFO: Saving data for HM47736: {'created_time': 1774644015.818917, 'last_price_update_time': 1774644015.818927, 'auction_closing_time': 1774714785.0}
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM47736') HTTP/1.1" 204 0
2026-03-27 20:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_9dbd9cb686a3420abdce80c88b323db8.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb45f55-3133-5a5a-9871-5c65e0a830e8 with identifier: BW39031
2026-03-27 20:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb45f55-3133-5a5a-9871-5c65e0a830e8 with scrape type 1
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eeb45f55-3133-5a5a-9871-5c65e0a830e8
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_5275d7b76b8867c57c592e30b9a0b630.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_5275d7b76b8867c57c592e30b9a0b630.jpg already downloaded
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_b7b28fa12f0599deb76a8f182b7ba74d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_b7b28fa12f0599deb76a8f182b7ba74d.jpg already downloaded
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_f414a2ecec90185ad81662a4c6672e02.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_f414a2ecec90185ad81662a4c6672e02.jpg already downloaded
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_d5a5c19664c1df4379cccd665d529878.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_d5a5c19664c1df4379cccd665d529878.jpg already downloaded
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_9f98132476e35f261e9f4d416b81bbde.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_9f98132476e35f261e9f4d416b81bbde.jpg already downloaded
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_aa9871e2a2ba0a621a22d17bd8a06bf6.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_aa9871e2a2ba0a621a22d17bd8a06bf6.jpg already downloaded
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_69bfb7695878f6f3f807aeff712cd83d.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_69bfb7695878f6f3f807aeff712cd83d.jpg already downloaded
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_c16203e7997db92a838d5af8e82cdac7.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_c16203e7997db92a838d5af8e82cdac7.jpg already downloaded
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_79135c5e9d96b92d77ae4ffc7fce0be8.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_79135c5e9d96b92d77ae4ffc7fce0be8.jpg already downloaded
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7c20d0045e3b158b9fb9d7cbd2af0%252Fpa%252FBW39031_cc81e4ed7bb275007936d7dbf82907ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 20:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_cc81e4ed7bb275007936d7dbf82907ac.jpg already downloaded
2026-03-27 20:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eeb45f55-3133-5a5a-9871-5c65e0a830e8, identifier: BW39031
2026-03-27 20:40:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 20:40:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 20:40:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 20:40:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 20:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903cc2750>
2026-03-27 20:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F25%252F7c258f3ae35b0ce26cddcfb2bdb60740%252Fpa%252FJJ27182_0cd099d0f3fe6eded6779beca675260b.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0cd099d0f3fe6eded6779beca675260b.jpg saved to cache
2026-03-27 20:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3
2026-03-27 20:40:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3, skipping ID generation
2026-03-27 20:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with scrape type 1
2026-03-27 20:40:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 sending to next pipeline
2026-03-27 20:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3, identifier: JJ27182
2026-03-27 20:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eeb45f55-3133-5a5a-9871-5c65e0a830e8 with identifier: BW39031
2026-03-27 20:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eeb45f55-3133-5a5a-9871-5c65e0a830e8 with identifier: BW39031
2026-03-27 20:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eeb45f55-3133-5a5a-9871-5c65e0a830e8 with identifier: BW39031 to the API
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW39031>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:37:10Z',
 'fuel_type': 'diesel',
 'id': 'eeb45f55-3133-5a5a-9871-5c65e0a830e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW39031',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 193665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_5275d7b76b8867c57c592e30b9a0b630.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_b7b28fa12f0599deb76a8f182b7ba74d.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_f414a2ecec90185ad81662a4c6672e02.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_d5a5c19664c1df4379cccd665d529878.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_9f98132476e35f261e9f4d416b81bbde.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_aa9871e2a2ba0a621a22d17bd8a06bf6.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_69bfb7695878f6f3f807aeff712cd83d.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_c16203e7997db92a838d5af8e82cdac7.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_79135c5e9d96b92d77ae4ffc7fce0be8.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_cc81e4ed7bb275007936d7dbf82907ac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_5275d7b76b8867c57c592e30b9a0b630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_b7b28fa12f0599deb76a8f182b7ba74d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_f414a2ecec90185ad81662a4c6672e02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_d5a5c19664c1df4379cccd665d529878.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_9f98132476e35f261e9f4d416b81bbde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_aa9871e2a2ba0a621a22d17bd8a06bf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_69bfb7695878f6f3f807aeff712cd83d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_c16203e7997db92a838d5af8e82cdac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_79135c5e9d96b92d77ae4ffc7fce0be8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb45f55-3133-5a5a-9871-5c65e0a830e8/eeb45f55-3133-5a5a-9871-5c65e0a830e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7c20d0045e3b158b9fb9d7cbd2af0/pa/BW39031_cc81e4ed7bb275007936d7dbf82907ac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2016}
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW39031%27 HTTP/1.1" 200 None
2026-03-27 20:40:16 [auto1.be] INFO: Saving data for BW39031: {'created_time': 1774644016.656443, 'last_price_update_time': 1774644016.656452, 'auction_closing_time': 1774715830.0}
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BW39031') HTTP/1.1" 204 0
2026-03-27 20:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-27 20:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182
2026-03-27 20:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3 with identifier: JJ27182 to the API
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0cd099d0f3fe6eded6779beca675260b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:33:46Z',
 'fuel_type': 'diesel',
 'id': '1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ27182',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 238550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 466100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0cd099d0f3fe6eded6779beca675260b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389128,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_87b77d91ecabf48129ec6dc2657214f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454905,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_99a580f0ec6028464115c5d0b10690e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2374691,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_ed164ea5ef145828f09d3b61456482f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_9ecbd487b66fbb9700249156f2a56d32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4a961bcb25e5afe6963fa9c2a4b3d1ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321427,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_7b7089ee2c4bf912ad364b4026378245.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_c128ef0958e6cba68e7e4e27861ae98e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_4d8822d39807c122b219220a8c5a1a1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3/1c1ed12c-eecd-5d3f-a2fa-faf0a89ffeb3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/25/7c258f3ae35b0ce26cddcfb2bdb60740/pa/JJ27182_0f8333b0afed18656ad979d7772abfa0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2012}
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-27 20:40:16 [auto1.be] INFO: Saving data for JJ27182: {'created_time': 1774644016.994636, 'last_price_update_time': 1774644016.994646, 'auction_closing_time': 1774715626.0}
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ27182') HTTP/1.1" 204 0
2026-03-27 20:40:17 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1659 | hits on page: 40
2026-03-27 20:40:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d48150>
2026-03-27 20:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc8%252F50c885f1a8327a1ba6a86cdb6a9ce406%252Fpa%252FSD77902_9dbd9cb686a3420abdce80c88b323db8.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_9dbd9cb686a3420abdce80c88b323db8.jpg saved to cache
2026-03-27 20:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3858bf66-719b-5ee3-a92c-0e3d097032db
2026-03-27 20:40:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3858bf66-719b-5ee3-a92c-0e3d097032db, skipping ID generation
2026-03-27 20:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3858bf66-719b-5ee3-a92c-0e3d097032db with scrape type 1
2026-03-27 20:40:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3858bf66-719b-5ee3-a92c-0e3d097032db sending to next pipeline
2026-03-27 20:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3858bf66-719b-5ee3-a92c-0e3d097032db, identifier: SD77902
2026-03-27 20:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-27 20:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902
2026-03-27 20:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3858bf66-719b-5ee3-a92c-0e3d097032db with identifier: SD77902 to the API
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_9dbd9cb686a3420abdce80c88b323db8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:56:33Z',
 'fuel_type': 'diesel',
 'id': '3858bf66-719b-5ee3-a92c-0e3d097032db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD77902',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 220247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2654514,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_cab76659845c0f6140a88bb592ebb0bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_9dbd9cb686a3420abdce80c88b323db8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_b37edc670bfba33fb15c5c0bcc0e7be7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2929298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e745b70cc804f5df0002a844370e7ef6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_becf66d78a7751ea27a83b75121527c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_218d367c98e8dadfd0ae2285e6f80e60.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789976,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_e37ce2884ae05e2e7968e3b0c2824d68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2699425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_88503113e9c7b93076e35dcac822144c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_2dde1adc073dccdf693d178ef9a15f28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3858bf66-719b-5ee3-a92c-0e3d097032db/3858bf66-719b-5ee3-a92c-0e3d097032db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c8/50c885f1a8327a1ba6a86cdb6a9ce406/pa/SD77902_fabc5ca22aec73ce72d2676223a7da30.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-19',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel',
 'transmission': 'manual',
 'trim': 'Travel',
 'year': 2010}
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-27 20:40:17 [auto1.be] INFO: Saving data for SD77902: {'created_time': 1774644017.628546, 'last_price_update_time': 1774644017.628557, 'auction_closing_time': 1774716993.0}
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD77902') HTTP/1.1" 204 0
2026-03-27 20:40:17 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-27 20:40:17 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-27 20:40:17 [auto1.be] INFO: Scrape type for AE13452: 2
2026-03-27 20:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-27 20:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310dcb03-133e-514f-86fb-8ea9a6203674 with scrape type 2
2026-03-27 20:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310dcb03-133e-514f-86fb-8ea9a6203674 with scrape type 2
2026-03-27 20:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 310dcb03-133e-514f-86fb-8ea9a6203674, identifier: AE13452
2026-03-27 20:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-27 20:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452
2026-03-27 20:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 310dcb03-133e-514f-86fb-8ea9a6203674 with identifier: AE13452 to the API
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:47:15Z',
 'fuel_type': 'petrol',
 'id': '310dcb03-133e-514f-86fb-8ea9a6203674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE13452',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 69362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Saving data for AE13452: {'auction_closing_time': 1774716435.0, 'created_time': 1773239795.139885, 'last_price_update_time': 1774644018.049255}
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE13452') HTTP/1.1" 204 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60132%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for YJ60132: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ69250%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for FJ69250: 2
2026-03-27 20:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb9af191-e660-566c-ae5d-f7898f80dbaa with identifier: FJ69250
2026-03-27 20:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb9af191-e660-566c-ae5d-f7898f80dbaa with scrape type 2
2026-03-27 20:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb9af191-e660-566c-ae5d-f7898f80dbaa with scrape type 2
2026-03-27 20:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb9af191-e660-566c-ae5d-f7898f80dbaa, identifier: FJ69250
2026-03-27 20:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb9af191-e660-566c-ae5d-f7898f80dbaa with identifier: FJ69250
2026-03-27 20:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb9af191-e660-566c-ae5d-f7898f80dbaa with identifier: FJ69250
2026-03-27 20:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb9af191-e660-566c-ae5d-f7898f80dbaa with identifier: FJ69250 to the API
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:50:22Z',
 'fuel_type': 'diesel',
 'id': 'cb9af191-e660-566c-ae5d-f7898f80dbaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ69250',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 150125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-07',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ69250%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Saving data for FJ69250: {'auction_closing_time': 1774716622.0, 'created_time': 1774438557.65881, 'last_price_update_time': 1774644018.747425}
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ69250') HTTP/1.1" 204 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB60498%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for CB60498: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-27 20:40:18 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-27 20:40:18 [auto1.be] INFO: Scrape type for RU48742: 2
2026-03-27 20:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-27 20:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df166cc3-cd8a-5d39-8640-02d6c5ff48ea with scrape type 2
2026-03-27 20:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df166cc3-cd8a-5d39-8640-02d6c5ff48ea with scrape type 2
2026-03-27 20:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df166cc3-cd8a-5d39-8640-02d6c5ff48ea, identifier: RU48742
2026-03-27 20:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-27 20:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742
2026-03-27 20:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df166cc3-cd8a-5d39-8640-02d6c5ff48ea with identifier: RU48742 to the API
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:00:10Z',
 'fuel_type': 'diesel',
 'id': 'df166cc3-cd8a-5d39-8640-02d6c5ff48ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU48742',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 108378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2020}
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-27 20:40:19 [auto1.be] INFO: Saving data for RU48742: {'auction_closing_time': 1774713610.0, 'created_time': 1773131807.255326, 'last_price_update_time': 1774644019.33967}
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU48742') HTTP/1.1" 204 0
2026-03-27 20:40:19 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-27 20:40:19 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-27 20:40:19 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-27 20:40:19 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-27 20:40:19 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-27 20:40:19 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-27 20:40:19 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-27 20:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_bb841add79fb558020faf4f54e83ba3e.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_ebf39d7be11d8c74735c66e5bc6dd906.jpg> (referer: https://www.auto1.com/)
2026-03-27 20:40:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe9032bb650>
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_1.jpg HTTP/1.1" 201 0
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_bb841add79fb558020faf4f54e83ba3e.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_bb841add79fb558020faf4f54e83ba3e.jpg saved to cache
2026-03-27 20:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:40:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe903d01b50>
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 20:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_0.jpg HTTP/1.1" 201 0
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F60%252F0b604699b214c431c62c397afd97c572%252Fpa%252FRK22486_ebf39d7be11d8c74735c66e5bc6dd906.jpg') HTTP/1.1" 204 0
2026-03-27 20:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_ebf39d7be11d8c74735c66e5bc6dd906.jpg saved to cache
2026-03-27 20:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c955914-1cd8-5dbb-9f85-02db094e5814
2026-03-27 20:40:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c955914-1cd8-5dbb-9f85-02db094e5814, skipping ID generation
2026-03-27 20:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c955914-1cd8-5dbb-9f85-02db094e5814 with scrape type 1
2026-03-27 20:40:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c955914-1cd8-5dbb-9f85-02db094e5814 sending to next pipeline
2026-03-27 20:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c955914-1cd8-5dbb-9f85-02db094e5814, identifier: RK22486
2026-03-27 20:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c955914-1cd8-5dbb-9f85-02db094e5814 with identifier: RK22486
2026-03-27 20:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c955914-1cd8-5dbb-9f85-02db094e5814 with identifier: RK22486
2026-03-27 20:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c955914-1cd8-5dbb-9f85-02db094e5814 with identifier: RK22486 to the API
2026-03-27 20:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_ebf39d7be11d8c74735c66e5bc6dd906.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:05:59Z',
 'fuel_type': 'diesel',
 'id': '9c955914-1cd8-5dbb-9f85-02db094e5814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK22486',
 'listing': 'auction',
 'location': 'BE, Ardooie',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 109268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2344637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_ebf39d7be11d8c74735c66e5bc6dd906.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2247952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_bb841add79fb558020faf4f54e83ba3e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_26afd886918c3f81f66b464bd5cb413d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_4d59c6aac01cc3a2f7487c8a4295d196.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2308094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_0c04bbfe0e601ada243a980ff5e8676c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1899552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_8779e883b7648c30f3674953b62d2000.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1911789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_fb898ea496b7eb9eca762c1de20987e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2164369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_3469afe72a4a70aeb7b63d44b1fe6225.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_7c518c4a5ac398416c93c8ddee101e4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c955914-1cd8-5dbb-9f85-02db094e5814/9c955914-1cd8-5dbb-9f85-02db094e5814_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2735446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/60/0b604699b214c431c62c397afd97c572/pa/RK22486_d1114395681961e105812009816599b6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten',
 'transmission': 'automatic',
 'trim': 'Kasten',
 'year': 2015}
2026-03-27 20:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK22486%27 HTTP/1.1" 200 None
2026-03-27 20:40:20 [auto1.be] INFO: Saving data for RK22486: {'created_time': 1774644020.293498, 'last_price_update_time': 1774644020.293508, 'auction_closing_time': 1774713959.0}
2026-03-27 20:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK22486') HTTP/1.1" 204 0
2026-03-27 20:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:21 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1659 | hits on page: 40
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for PJ20685: 2
2026-03-27 20:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-27 20:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with scrape type 2
2026-03-27 20:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with scrape type 2
2026-03-27 20:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a34909d-0f97-58e7-afcb-02caf3ffeb80, identifier: PJ20685
2026-03-27 20:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-27 20:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685
2026-03-27 20:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a34909d-0f97-58e7-afcb-02caf3ffeb80 with identifier: PJ20685 to the API
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:29:25Z',
 'fuel_type': 'petrol',
 'id': '0a34909d-0f97-58e7-afcb-02caf3ffeb80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ20685',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 43724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2021}
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Saving data for PJ20685: {'auction_closing_time': 1774715365.0, 'created_time': 1773239954.362352, 'last_price_update_time': 1774644021.634378}
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ20685') HTTP/1.1" 204 0
2026-03-27 20:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-27 20:40:21 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-27 20:40:21 [auto1.be] INFO: Scrape type for RW94228: 2
2026-03-27 20:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-27 20:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with scrape type 2
2026-03-27 20:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with scrape type 2
2026-03-27 20:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 809dd09e-4224-5e52-aeff-e7f87afe2fd7, identifier: RW94228
2026-03-27 20:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-27 20:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228
2026-03-27 20:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 809dd09e-4224-5e52-aeff-e7f87afe2fd7 with identifier: RW94228 to the API
2026-03-27 20:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:44:51Z',
 'fuel_type': 'petrol',
 'id': '809dd09e-4224-5e52-aeff-e7f87afe2fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW94228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-09',
 'seller_name': None,
 'title': 'BMW 3er 330i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Saving data for RW94228: {'auction_closing_time': 1774716291.0, 'created_time': 1773834432.483127, 'last_price_update_time': 1774644022.15542}
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW94228') HTTP/1.1" 204 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for EK72945: 2
2026-03-27 20:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-27 20:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5ed6b60-6709-5554-b716-4d6806724a89 with scrape type 2
2026-03-27 20:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5ed6b60-6709-5554-b716-4d6806724a89 with scrape type 2
2026-03-27 20:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d5ed6b60-6709-5554-b716-4d6806724a89, identifier: EK72945
2026-03-27 20:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-27 20:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945
2026-03-27 20:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d5ed6b60-6709-5554-b716-4d6806724a89 with identifier: EK72945 to the API
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:56:29Z',
 'fuel_type': 'petrol',
 'id': 'd5ed6b60-6709-5554-b716-4d6806724a89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK72945',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 157243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-09',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Attract",
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2014}
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Saving data for EK72945: {'auction_closing_time': 1774716989.0, 'created_time': 1773134803.074061, 'last_price_update_time': 1774644022.708402}
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK72945') HTTP/1.1" 204 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD51863%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for ZD51863: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for MD39375: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-27 20:40:22 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-27 20:40:22 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-27 20:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:23 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1659 | hits on page: 40
2026-03-27 20:40:23 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-27 20:40:23 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-27 20:40:23 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-27 20:40:23 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-27 20:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-27 20:40:23 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-27 20:40:23 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-27 20:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-27 20:40:23 [auto1.be] INFO: Scrape type for JS91755: 2
2026-03-27 20:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-27 20:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with scrape type 2
2026-03-27 20:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with scrape type 2
2026-03-27 20:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc, identifier: JS91755
2026-03-27 20:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-27 20:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755
2026-03-27 20:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c6c3904-b97d-5ba7-a81b-20e6b5724bcc with identifier: JS91755 to the API
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:54:31Z',
 'fuel_type': 'diesel',
 'id': '4c6c3904-b97d-5ba7-a81b-20e6b5724bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS91755',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 243744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2014}
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Saving data for JS91755: {'auction_closing_time': 1774716871.0, 'created_time': 1773240662.024707, 'last_price_update_time': 1774644024.385301}
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS91755') HTTP/1.1" 204 0
2026-03-27 20:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-27 20:40:24 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-27 20:40:24 [auto1.be] INFO: Scrape type for NK56969: 2
2026-03-27 20:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-27 20:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b69580-4a85-5b00-afa1-c61fd457ef90 with scrape type 2
2026-03-27 20:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57b69580-4a85-5b00-afa1-c61fd457ef90 with scrape type 2
2026-03-27 20:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 57b69580-4a85-5b00-afa1-c61fd457ef90, identifier: NK56969
2026-03-27 20:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-27 20:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969
2026-03-27 20:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 57b69580-4a85-5b00-afa1-c61fd457ef90 with identifier: NK56969 to the API
2026-03-27 20:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:01Z',
 'fuel_type': 'petrol',
 'id': '57b69580-4a85-5b00-afa1-c61fd457ef90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK56969',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 73009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-27 20:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-27 20:40:25 [auto1.be] INFO: Saving data for NK56969: {'auction_closing_time': 1774715101.0, 'created_time': 1773240401.028257, 'last_price_update_time': 1774644025.156311}
2026-03-27 20:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NK56969') HTTP/1.1" 204 0
2026-03-27 20:40:25 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-27 20:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY53837%27 HTTP/1.1" 200 None
2026-03-27 20:40:25 [auto1.be] INFO: Scrape type for NY53837: 0
2026-03-27 20:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:26 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1659 | hits on page: 40
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV40639%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for FV40639: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU84298%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for JU84298: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23353%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for BC23353: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF18972%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for JF18972: 0
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-27 20:40:26 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA37935%27 HTTP/1.1" 200 None
2026-03-27 20:40:26 [auto1.be] INFO: Scrape type for YA37935: 0
2026-03-27 20:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:27 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1659 | hits on page: 19
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ45584%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for JJ45584: 0
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-27 20:40:27 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-27 20:40:27 [auto1.be] INFO: Scrape type for NB71425: 2
2026-03-27 20:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-27 20:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a057a9dc-fb8e-5001-997b-63384be95c51 with scrape type 2
2026-03-27 20:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a057a9dc-fb8e-5001-997b-63384be95c51 with scrape type 2
2026-03-27 20:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a057a9dc-fb8e-5001-997b-63384be95c51, identifier: NB71425
2026-03-27 20:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-27 20:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425
2026-03-27 20:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a057a9dc-fb8e-5001-997b-63384be95c51 with identifier: NB71425 to the API
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:58Z',
 'fuel_type': 'diesel',
 'id': 'a057a9dc-fb8e-5001-997b-63384be95c51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB71425',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 107273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-27 20:40:28 [auto1.be] INFO: Saving data for NB71425: {'auction_closing_time': 1774715158.0, 'created_time': 1773240638.008076, 'last_price_update_time': 1774644028.011125}
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB71425') HTTP/1.1" 204 0
2026-03-27 20:40:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 20:40:28 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-27 20:40:28 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-27 20:40:28 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-27 20:40:28 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-27 20:40:28 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-27 20:40:28 [auto1.be] INFO: Scrape type for CK49467: 2
2026-03-27 20:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-27 20:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc0a755-e8d6-565a-ae23-49098886fea8 with scrape type 2
2026-03-27 20:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abc0a755-e8d6-565a-ae23-49098886fea8 with scrape type 2
2026-03-27 20:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abc0a755-e8d6-565a-ae23-49098886fea8, identifier: CK49467
2026-03-27 20:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-27 20:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467
2026-03-27 20:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abc0a755-e8d6-565a-ae23-49098886fea8 with identifier: CK49467 to the API
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 20:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:52Z',
 'fuel_type': 'diesel',
 'id': 'abc0a755-e8d6-565a-ae23-49098886fea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK49467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 84175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2015}
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-27 20:40:28 [auto1.be] INFO: Saving data for CK49467: {'auction_closing_time': 1774716412.0, 'created_time': 1773225621.316862, 'last_price_update_time': 1774644028.535648}
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 20:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK49467') HTTP/1.1" 204 0
2026-03-27 20:40:28 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-27 20:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 20:40:29 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1659 | hits on page: 0
2026-03-27 20:40:29 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 20:40:29 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-27 20:40:29 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1, <ScrapeType.BATCH_SKIPPED: 5>: 3}
2026-03-27 20:40:29 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (320 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-27T20_35_00.jl
2026-03-27 20:40:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1841862,
 'downloader/request_count': 1071,
 'downloader/request_method_count/GET': 1026,
 'downloader/request_method_count/POST': 45,
 'downloader/response_bytes': 713078106,
 'downloader/response_count': 1071,
 'downloader/response_status_count/200': 1071,
 'dupefilter/filtered': 1,
 'elapsed_time_seconds': 322.687872,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 20, 40, 29, 389135, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 320,
 'log_count/DEBUG': 11387,
 'log_count/INFO': 11161,
 'memusage/max': 209031168,
 'memusage/startup': 147865600,
 'photo_download_count': 758,
 'request_depth_max': 46,
 'response_received_count': 313,
 'scheduler/dequeued': 1071,
 'scheduler/dequeued/memory': 1071,
 'scheduler/enqueued': 1071,
 'scheduler/enqueued/memory': 1071,
 'scrape_type/batch_skipped': 879,
 'scrape_type/new': 133,
 'scrape_type/price_update': 187,
 'scrape_type/skipped': 499,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 313,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.0369758814478063,
 'scrapy-zyte-api/mean_response_seconds': 3.0697233704775693,
 'scrapy-zyte-api/processed': 313,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 313,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 312,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 313,
 'scrapy-zyte-api/request_args/httpRequestBody': 45,
 'scrapy-zyte-api/request_args/httpRequestMethod': 45,
 'scrapy-zyte-api/request_args/httpResponseBody': 313,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 313,
 'scrapy-zyte-api/request_args/sessionContext': 313,
 'scrapy-zyte-api/request_args/url': 313,
 'scrapy-zyte-api/status_codes/200': 313,
 'scrapy-zyte-api/success': 313,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1699,
 'source/total_available': 1659,
 'start_time': datetime.datetime(2026, 3, 27, 20, 35, 6, 701263, tzinfo=datetime.timezone.utc)}
2026-03-27 20:40:29 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 20:40:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe9121dcf10>
2026-03-27 20:40:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe911f83fd0>